{"id":656,"date":"2017-08-31T11:03:19","date_gmt":"2017-08-31T09:03:19","guid":{"rendered":"http:\/\/blogs.igalia.com\/xrcalvar\/?p=656"},"modified":"2017-09-04T08:56:31","modified_gmt":"2017-09-04T06:56:31","slug":"some-rough-numbers-on-webkit-code","status":"publish","type":"post","link":"https:\/\/blogs.igalia.com\/xrcalvar\/2017\/08\/31\/some-rough-numbers-on-webkit-code\/","title":{"rendered":"Some rough numbers on WebKit code"},"content":{"rendered":"

My wife<\/a> asked me for some rough LOC numbers on the WebKit<\/a> project and I think I could share them with you here as well. They come from r221232<\/a>. As I’ll take into account some generated code it is relevant to mention that I built WebKitGTK+<\/a> with the default CMake<\/em> options.<\/p>\n

First thing I did was running sloccount Source<\/code> and got the following numbers:<\/p>\n

cpp: 2526061 (70.57%)
\nansic: 396906 (11.09%)
\nasm: 207284 (5.79%)
\njavascript: 175059 (4.89%)
\njava: 74458 (2.08%)
\nperl: 73331 (2.05%)
\nobjc: 44422 (1.24%)
\npython: 38862 (1.09%)
\ncs: 13011 (0.36%)
\nruby: 11605 (0.32%)
\nxml: 11396 (0.32%)
\nsh: 3747 (0.10%)
\nyacc: 2167 (0.06%)
\nlex: 1007 (0.03%)
\nlisp: 89 (0.00%)
\nphp: 10 (0.00%)<\/code><\/p>\n

This number do not include IDL code so I did some grepping<\/em> to get the number myself that gave me 19632<\/em> IDL lines:<\/p>\n

$ find Source\/ -name \".idl\" | xargs cat | grep -ve \"^[[:space:]]<\/em>\\\/*\" -ve \"^[[:space:]]*\" -ve \"^[[:space:]]<\/em>$\" -ve \"^[[:space:]][$\" -ve \"^[[:space:]]<\/em>};$\" | wc -l
\n19632<\/code><\/p>\n

The interesting part of the IDL files is that they are used to generate code so those 19632 IDL lines expand to:<\/p>\n

ansic: 699140 (65.25%)
\ncpp: 368720 (34.41%)
\npython: 1492 (0.14%)
\nxml: 1040 (0.10%)
\njavascript: 883 (0.08%)
\nasm: 169 (0.02%)
\nperl: 11 (0.00%)<\/code><\/p>\n

Let’s have a look now at the LayoutTests<\/em> (they test the functionality of WebCore<\/em> + the platform). Tests are composed mainly by HTML<\/em> files so if you run sloccount LayoutTests<\/code> you get:<\/p>\n

javascript: 401159 (76.74%)
\npython: 87231 (16.69%)
\nxml: 22978 (4.40%)
\nphp: 4784 (0.92%)
\nansic: 3661 (0.70%)
\nperl: 2726 (0.52%)
\nsh: 199 (0.04%)<\/code><\/p>\n

It’s quite interesting to see that sloccount<\/em> does not consider HTML<\/em> which is quite relevant when you’re testing a web engine so again, we have to count them manually (thanks to Carlos L\u00f3pez<\/a> who helped me to properly grep here as some binary lines were giving me a headache to get the numbers):<\/p>\n

find LayoutTests\/ -name \".html\" -print0 | xargs -0 cat | strings | grep -Pv \"^[[:space:]]<\/em>$\" | wc -l
\n2205690<\/code><\/p>\n

You can see 2205690 of “meaningful lines” that combine HTML<\/em> + other languages that you can see above. I can’t substract here to just get the HTML<\/em> lines because the number above take into account files with a different extension than HTML<\/em>, though many of them do include other languages, specially JavaScript<\/em>.<\/p>\n

But the LayoutTests<\/em> do not include only pure WebKit tests. There are some imported ones so it might be interesting to run the same procedure under LayoutTests\/imported<\/code> to see which ones are imported and not written directly into the WebKit project<\/em>. I emphasize that because they can be written by WebKit developers in other repositories and actually I can present myself and Youenn Fablet as an example as we wrote tests some tests that were finally moved into the specification and included back later when imported. So again, sloccount LayoutTests\/imported<\/code>:<\/p>\n

python: 84803 (59.99%)
\njavascript: 51794 (36.64%)
\nansic: 3661 (2.59%)
\nphp: 575 (0.41%)
\nxml: 250 (0.18%)
\nsh: 199 (0.14%)
\nperl: 86 (0.06%)<\/code><\/p>\n

The same procedure to count HTML + other stuff<\/em> lines inside that directory gives a number of 295490:<\/p>\n

$ find LayoutTests\/imported\/ -name \".html\" -print0 | xargs -0 cat | strings | grep -Pv \"^[[:space:]]<\/em>$\" | wc -l
\n295490<\/code><\/p>\n

There are also some other tests that we can talk about, for example the JSTests<\/em>. I’ll mention already the numbers summed up regarding languages and the manual HTML<\/em> code (if you made it here, you know the drill already):<\/p>\n

javascript: 1713200 (98.64%)
\nxml: 20665 (1.19%)
\nperl: 2449 (0.14%)
\npython: 421 (0.02%)
\nruby: 56 (0.00%)
\nsh: 38 (0.00%)
\nHTML+stuff: 997<\/code><\/p>\n

ManualTests<\/em>:<\/p>\n

javascript: 297 (41.02%)
\nansic: 187 (25.83%)
\njava: 118 (16.30%)
\nxml: 103 (14.23%)
\nphp: 10 (1.38%)
\nperl: 9 (1.24%)
\nHTML+stuff: 16026<\/code><\/p>\n

PerformanceTests<\/em>:<\/p>\n

javascript: 950916 (83.12%)
\ncpp: 147194 (12.87%)
\nansic: 38540 (3.37%)
\nasm: 5466 (0.48%)
\nsh: 872 (0.08%)
\nruby: 419 (0.04%)
\nperl: 348 (0.03%)
\npython: 325 (0.03%)
\nxml: 5 (0.00%)
\nHTML+stuff: 238002<\/code><\/p>\n

TestsWebKitAPI<\/em>:<\/p>\n

cpp: 44753 (99.45%)
\nansic: 163 (0.36%)
\nobjc: 76 (0.17%)
\nxml: 7 (0.02%)
\njavascript: 1 (0.00%)
\nHTML+stuff: 3887<\/code><\/p>\n

And this is all. Remember that these are just some rough statistics, not a “scientific” paper.<\/p>\n

Update:<\/strong><\/p>\n

In her expert opinion, in the WebKit project we are devoting around 50% of the total LOC to testing, which makes it a software engineering “textbook” project regarding testing and I think we can be proud of it!<\/p>\n","protected":false},"excerpt":{"rendered":"

My wife asked me for some rough LOC numbers on the WebKit project and I think I could share them with you here as well. They come from r221232. As I’ll take into account some generated code it is relevant … Continue reading →<\/span><\/a><\/p>\n","protected":false},"author":31,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4,8,9,43,44],"tags":[74,75,33,41],"class_list":["post-656","post","type-post","status-publish","format-standard","hentry","category-igaliacom","category-planet-gpul","category-planet-igalia","category-planet-webkit","category-planet-webkitgtk","tag-code","tag-loc","tag-tests","tag-webkit"],"_links":{"self":[{"href":"https:\/\/blogs.igalia.com\/xrcalvar\/wp-json\/wp\/v2\/posts\/656","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.igalia.com\/xrcalvar\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.igalia.com\/xrcalvar\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.igalia.com\/xrcalvar\/wp-json\/wp\/v2\/users\/31"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.igalia.com\/xrcalvar\/wp-json\/wp\/v2\/comments?post=656"}],"version-history":[{"count":28,"href":"https:\/\/blogs.igalia.com\/xrcalvar\/wp-json\/wp\/v2\/posts\/656\/revisions"}],"predecessor-version":[{"id":684,"href":"https:\/\/blogs.igalia.com\/xrcalvar\/wp-json\/wp\/v2\/posts\/656\/revisions\/684"}],"wp:attachment":[{"href":"https:\/\/blogs.igalia.com\/xrcalvar\/wp-json\/wp\/v2\/media?parent=656"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.igalia.com\/xrcalvar\/wp-json\/wp\/v2\/categories?post=656"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.igalia.com\/xrcalvar\/wp-json\/wp\/v2\/tags?post=656"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}