{"id":324,"date":"2015-03-10T21:22:48","date_gmt":"2015-03-10T21:22:48","guid":{"rendered":"http:\/\/blogs.ubalt.edu\/cstarger\/?p=324"},"modified":"2022-06-11T20:14:47","modified_gmt":"2022-06-11T20:14:47","slug":"network-editing-man-v-machine","status":"publish","type":"post","link":"https:\/\/blogs.ubalt.edu\/cstarger\/2015\/03\/10\/network-editing-man-v-machine\/","title":{"rendered":"Network Editing: Man v. Machine"},"content":{"rendered":"<p>This semester I&#8217;m teaching First Amendment law for the very first time and it&#8217;s proving to be a wonderful experience. First Amendment cases have great stories behind them and the Supreme Court&#8217;s doctrine is complex and highly contested. To navigate this complexity, I&#8217;ve found doctrinal mapping enormously useful for my own learning. Yet I&#8217;ve also realized\u00a0that automatically generated citation networks need editing. Today I want to discuss this editing process.<\/p>\n<p>The example I&#8217;ll use is the Court&#8217;s &#8220;commercial speech&#8221; doctrine, which generally concerns\u00a0acceptable versus unacceptable restrictions on advertising. The section on commercial speech spans 27 pages of our class textbook &#8212; the excellent (imho) Sullivan &amp; Feldman <em>First Amendment<\/em> volume (5th Ed. 2013) &#8212; and it discusses\u00a023 cases. There are three principal cases (<em>Virginia Pharmacy<\/em> (1976), <em>Central Hudson<\/em> (1980), and <em>44 Liquormart<\/em> (1996)) and 20 squibs. The latest squib is the only Roberts Court decision &#8212; <em>Sorrell<\/em> (2011). For the purposes of this analysis, I&#8217;ll call these 23 cases the Sullivan &amp; Feldman canonical cases.<\/p>\n<p>To create a machine-made competing\u00a0map, I used SCOTUS Mapper to generate\u00a0a 2-degree network linking <em>Sorrell<\/em> to <em>Virginia Pharmacy<\/em>. The program&#8217;s algorithm pulls into the network all the cases that <em>Sorrell<\/em> cites that in turn cite <em>Virginia Pharmacy<\/em>. This is what that network looks like (as with all the images in this post, click for full-size map).<\/p>\n<p><a href=\"http:\/\/home.ubalt.edu\/id86mp66\/1A_Commercial%20Speech\/Sorrell_to_VA_2degree_random.html\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-327\" src=\"http:\/\/blogs.ubalt.edu\/cstarger\/wp-content\/uploads\/sites\/273\/2015\/03\/Sorrell_to_VA_2degree_random.jpg\" alt=\"Sorrell_to_VA_2degree_random\" width=\"1200\" height=\"600\" \/><\/a>\u00a0Now this 2-degree network is actually quite rich. It contains 25 cases &#8212; including all three of the Sullivan &amp; Feldman principal cases as well as 11 of the 20 squibs. While the 2-degree network thus picks up 14 out of the 23 canonical cases, it also picks up 11 &#8220;extra&#8221; cases not included in the canonical line.<\/p>\n<p>I wanted to edit out these extra cases so I ran the network through a text filter on &#8220;commercial speech.&#8221; This machine-based edit knocked out 4 cases (the remaining 21 cases all contained the phrase). From there, I had to edit out by hand the 7 cases that Sullivan &amp; Feldman did not include in the canonical line. (Let&#8217;s call those cases &#8220;non-canonical 7&#8221; &#8212; I&#8217;ll return to them below). After that editing, I ended up with this map:<\/p>\n<p><a href=\"http:\/\/home.ubalt.edu\/id86mp66\/1A_Commercial%20Speech\/Sorrell_to_VA_2degree_edited_genealogy.html\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-329\" src=\"http:\/\/blogs.ubalt.edu\/cstarger\/wp-content\/uploads\/sites\/273\/2015\/03\/Sorrell_to_VA_2degree_edited_genealogy.jpg\" alt=\"Sorrell_to_VA_2degree_edited_genealogy\" width=\"1049\" height=\"776\" \/><\/a><\/p>\n<p>Note that this second map uses a &#8220;Spaeth projection.&#8221; The Y axis is no longer random &#8212; it represents that Supreme Court Database code\u00a0for both outcome direction and judgment vote. Red cases are Spaeth-coded &#8220;conservative&#8221; &#8212; meaning the Court upheld a restriction on commercial speech. Blue cases are Spaeth-coded &#8220;liberal&#8221; &#8212; meaning the Court struck down a restriction on commercial speech.<\/p>\n<p>Now what does\u00a0it take to automatically capture the remaining 9 squib cases from the Sullivan &amp; Feldman canonical line? I tried generating a 3-degree network connecting <em>Sorell<\/em> to <em>Virginia Pharmacy<\/em>. So in addition to all the 2-degree cases, this network includes all the cases cited by 2-degree cases that in turn cite <em>Virginia Pharmacy<\/em>. Here&#8217;s what that network looks like on a random Y-axis projection:<\/p>\n<p><a href=\"http:\/\/home.ubalt.edu\/id86mp66\/1A_Commercial%20Speech\/Sorrell_to_VA_3degree_random.html\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-330\" src=\"http:\/\/blogs.ubalt.edu\/cstarger\/wp-content\/uploads\/sites\/273\/2015\/03\/Sorrell_to_VA_3degree_random.jpg\" alt=\"Sorrell_to_VA_3degree_random\" width=\"1200\" height=\"699\" \/><\/a><\/p>\n<p>Unsurprisingly, this network is very large &#8212; 81 cases. The good news is that the network easily picks up all 23 cases from the Sullivan &amp; Feldman canonical line. The bad news is that it picks up 58 extra cases.<\/p>\n<p>To get rid of these, I first tried the machine filter route. After automatically excluding cases without the phrase &#8220;commercial speech&#8221;, the network shrunk from 81 to 53 cases. Once again, that&#8217;s a good start but not nearly good enough. To get rid of the other 20 cases, I had to edit by hand. Upon completion of that edit, here&#8217;s what the new network looks like using a Spaeth projection:<\/p>\n<p><a href=\"http:\/\/home.ubalt.edu\/id86mp66\/1A_Commercial%20Speech\/Sorrell_to_VA_3degree_edited_genealogy.html\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-332\" src=\"http:\/\/blogs.ubalt.edu\/cstarger\/wp-content\/uploads\/sites\/273\/2015\/03\/Sorrell_to_VA_3degree_edited_genealogy.jpg\" alt=\"Sorrell_to_VA_3degree_edited_genealogy\" width=\"1200\" height=\"642\" \/><\/a>This map represents all the Sullivan &amp; Feldman canonical commercial speech cases. Getting those extra 9 cases in requires a healthy\u00a0dose\u00a0of editing of the 3-degree network.<\/p>\n<p>So how important are those extra 9 cases? Are they really part of the core commercial speech line? All that we can conclude for certain is that none of the opinions in <em>Sorrell<\/em> cited those 9 cases. As far as the justices sitting in 2011 were concerned, none of those 9 cases was important in justifying their decisions. Of course, the diminished &#8220;2011 value&#8221; of the cases does not mean that &#8220;the missing 9&#8221; had no impact on the network&#8217;s development.<\/p>\n<p>Comparing the 2- and 3-degree edited maps, one feature jumped out at me: almost half of the canonical cases missed by the 2-degree map concerned lawyer advertising (4 out of the 9 missed cases). \u00a0With a little more editing, I modified the last map to highlight the lawyer advertising cases in magenta.\u00a0This is the result:<\/p>\n<p><a href=\"http:\/\/home.ubalt.edu\/id86mp66\/1A_Commercial%20Speech\/Sorell_to_VA_3degree_edited_genealogy_lawyer.html\" target=\"_blank\" rel=\"noopener noreferrer\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-333\" src=\"http:\/\/blogs.ubalt.edu\/cstarger\/wp-content\/uploads\/sites\/273\/2015\/03\/Sorell_to_VA_3degree_edited_genealogy_lawyer.jpg\" alt=\"Sorell_to_VA_3degree_edited_genealogy_lawyer\" width=\"1200\" height=\"642\" \/><\/a><\/p>\n<p>With the benefit of this new visualization, we can easily appreciate how the Sullivan &amp; Feldman text took a deeper academic dive into the lawyer advertising cases that the\u00a0<em>Sorrell<\/em> opinions found necessary. It seems hard to fault <em>Sorell<\/em>\u00a0for only citing 3 of the 7 cases in the magenta line.<\/p>\n<p>The other 5 missed cases &#8212; <em>Carey<\/em> (1977), <em>Metromedia<\/em> (1981), <em>Posadas<\/em> (1986), <em>United Reporting<\/em> (1999), and <em>Lorillard<\/em> (2001) &#8212; are certainly important. But are they more important than the &#8220;non-canonical 7&#8221; cases referred to above? Recall those are the 7 cases included in the 2-degree network after applying the &#8220;commercial speech&#8221; filter. In other words, those are ostensibly commercial speech cases cited in <em>Sorrell<\/em> but not included in Sullivan &amp; Feldman.<\/p>\n<p>Forgive me as I dive deep into the First Amendment weeds for just a moment more and name the &#8220;non-canonical 7&#8221; cases:\u00a0<em>Dun &amp; Bradstreet<\/em> (1985), <em>RAV<\/em> (1992), <em>Edenfield<\/em> (1993), <em>Glickman<\/em> (1997), <em>Greater New Orleans Broadcasting<\/em> (1999), <em>Playboy<\/em> (2000), and <em>United Foods<\/em> (2001). Three of those cases (<em>Dun &amp; Bradstreet<\/em>, <em>RAV<\/em>, and <em>Playboy<\/em>) certainly do not belong the main commercial speech line. But the other four do. And they are arguably as important as the 5 missed cases above.<\/p>\n<p>Now let&#8217;s step back and review. Sullivan &amp; Feldman have 23 cases in their (human created) canonical network. \u00a0The machine generated 2-degree network (filtered for commercial speech) has 21 cases. 14 cases overlap between the networks and are clearly core to the line. Of the 9 cases captured by Sullivan &amp; Feldman but not the machine, all are relevant and 5 are\u00a0uniquely so. Of the 7 cases captured by the machine but not by Sullivan &amp; Feldman, 3 are irrelevant and 4 are uniquely relevant.<\/p>\n<p>All in all &#8212; Sullivan and Feldman&#8217;s editing fares better. This is as you would hope and expect. But the 2-degree network is still remarkably efficient at identifying relevant cases. (The 3-degree network, on the other hand, is far too large and unwieldy.) And the machine-generate network approach suggests potentially fruitful doctrinal angles for further reading outside of the Sullivan &amp; Feldman line.<\/p>\n<p>In the end, it bears emphasis that identifying relevant cases is very different from reading and understanding those cases. And in that department, the human editing of a casebook is completely indispensable. It would probably take 100s of extra hours to read unedited versions of cases identified by the 2-degree network. So thank your stars for human editors!<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>This semester I&#8217;m teaching First Amendment law for the very first time and it&#8217;s proving to be a wonderful experience. First Amendment cases have great stories behind them and the Supreme Court&#8217;s doctrine is complex and highly contested. To navigate &hellip; <a href=\"https:\/\/blogs.ubalt.edu\/cstarger\/2015\/03\/10\/network-editing-man-v-machine\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":400,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/blogs.ubalt.edu\/cstarger\/wp-json\/wp\/v2\/posts\/324"}],"collection":[{"href":"https:\/\/blogs.ubalt.edu\/cstarger\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ubalt.edu\/cstarger\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/cstarger\/wp-json\/wp\/v2\/users\/400"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/cstarger\/wp-json\/wp\/v2\/comments?post=324"}],"version-history":[{"count":8,"href":"https:\/\/blogs.ubalt.edu\/cstarger\/wp-json\/wp\/v2\/posts\/324\/revisions"}],"predecessor-version":[{"id":870,"href":"https:\/\/blogs.ubalt.edu\/cstarger\/wp-json\/wp\/v2\/posts\/324\/revisions\/870"}],"wp:attachment":[{"href":"https:\/\/blogs.ubalt.edu\/cstarger\/wp-json\/wp\/v2\/media?parent=324"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/cstarger\/wp-json\/wp\/v2\/categories?post=324"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ubalt.edu\/cstarger\/wp-json\/wp\/v2\/tags?post=324"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}