weixin_39628105
weixin_39628105
2020-12-09 13:48

Find outlier decision dates

We should be able to do a report of likely-incorrect decision dates based on variance. Like if a volume has a bunch of dates between 1658 and 1800, that's fine, but if it has all dates in 1940 and one date in 1640, that's an error. Could maybe calculate the standard deviation for each volume and report dates > a given number of standard deviations from the mean.

该提问来源于开源项目:harvard-lil/capstone

  • 点赞
  • 写回答
  • 关注问题
  • 收藏
  • 复制链接分享
  • 邀请回答

12条回答

  • weixin_39574065 weixin_39574065 5月前

    Here's a list of cases/volumes in which the decision date is greater than the publication year value.

    https://docs.google.com/spreadsheets/d/1BkJIO8gcU7esFge052CIZWeeTNe-Yd-O2ugy63va8yc/edit?usp=sharing

    点赞 评论 复制链接分享
  • weixin_39574065 weixin_39574065 5月前

    New spreadsheet for the statistical method: https://docs.google.com/spreadsheets/d/1cnoJaEMYSNNFhjhMzchRlLecrrkraG2X-NtgYuXtoqY/edit?usp=sharing

    点赞 评论 复制链接分享
  • weixin_39628105 weixin_39628105 5月前

    I did a little processing of the statistical spreadsheet to find rows where the likely-wrong date was one Damerau–Levenshtein edit away from a statistically likely date, and see if it would make sense to update those dates automatically.

    https://github.com/harvard-lil/capstone/pull/1532

    From the output, it's hard for me to tell if these are actual errors, even the ones with high deviation. Often they seem to either be cases the reporter intentionally included from a decade or two previously, or cases where the reporter typo'd a date a decade or two earlier but it's hard to find conclusive evidence of that in the text.

    Output -- rows are [deviations, wrong_date, corrected_date, url]

    [[inf, '2004', '2014', 'https://cite.case.law/a3d/89/32/'],
     [inf, '2000', '2010', 'https://cite.case.law/or-app/239/101/'],
     [inf, '1988', '1998', 'https://cite.case.law/tca/4/13/'],
     [inf, '1982', '1992', 'https://cite.case.law/pr-dec/131/1/'],
     [inf, '1982', '1992', 'https://cite.case.law/ark-app/37/18/'],
     [inf, '1980', '1990', 'https://cite.case.law/cal-app-3d/219/1390/'],
     [inf, '1980', '1990', 'https://cite.case.law/cal-app-3d/218/828/'],
     [inf, '1977', '1997', 'https://cite.case.law/cal-app-4th/59/1289/'],
     [inf, '1963', '1973', 'https://cite.case.law/ind-app/156/265/'],
     [inf, '1958', '1968', 'https://cite.case.law/ga-app/118/100/'],
     [inf, '1958', '1968', 'https://cite.case.law/ark/244/142/'],
     [inf, '1957', '1967', 'https://cite.case.law/colo/163/121/'],
     [inf, '1952', '1992', 'https://cite.case.law/mass-app-ct/32/501/'],
     [inf, '1952', '1962', 'https://cite.case.law/pa-super/199/489/'],
     [inf, '1950', '1960', 'https://cite.case.law/nc/252/485/'],
     [inf, '1948', '1958', 'https://cite.case.law/kan/183/224/'],
     [inf, '1939', '1959', 'https://cite.case.law/p2d/343/1069/'],
     [inf, '1936', '1966', 'https://cite.case.law/cal-2d/64/529/'],
     [inf, '1933', '1993', 'https://cite.case.law/cal-app-4th/17/1/'],
     [inf, '1933', '1943', 'https://cite.case.law/tex/141/565/'],
     [inf, '1932', '1952', 'https://cite.case.law/ill/412/383/'],
     [inf, '1931', '1941', 'https://cite.case.law/sw2d/152/774/'],
     [inf, '1928', '1938', 'https://cite.case.law/wis/227/519/'],
     [inf, '1928', '1938', 'https://cite.case.law/wis/227/506/'],
     [inf, '1928', '1938', 'https://cite.case.law/wis/227/407/'],
     [inf, '1925', '1975', 'https://cite.case.law/colo/189/429/'],
     [inf, '1924', '1934', 'https://cite.case.law/sc/172/329/'],
     [inf, '1921', '1931', 'https://cite.case.law/mont/90/344/'],
     [inf, '1920', '1930', 'https://cite.case.law/sc/156/232/'],
     [inf, '1920', '1930', 'https://cite.case.law/bta/20/206/'],
     [inf, '1918', '1928', 'https://cite.case.law/wis/195/361/'],
     [inf, '1918', '1928', 'https://cite.case.law/ga/166/323/'],
     [inf, '1918', '1928', 'https://cite.case.law/ga/166/293/'],
     [inf, '1917', '1947', 'https://cite.case.law/cal-app-2d/82/592/'],
     [inf, '1914', '1941', 'https://cite.case.law/ga/192/118/'],
     [inf, '1914', '1924', 'https://cite.case.law/minn/159/290/'],
     [inf, '1913', '1923', 'https://cite.case.law/pa-super/81/140/'],
     [inf, '1912', '1942', 'https://cite.case.law/ark/204/1112/'],
     [inf, '1910', '1920', 'https://cite.case.law/ny/228/605/'],
     [inf, '1907', '1967', 'https://cite.case.law/ariz/102/595/'],
     [inf, '1907', '1967', 'https://cite.case.law/ariz/102/335/'],
     [inf, '1904', '1914', 'https://cite.case.law/pa-super/57/37/'],
     [inf, '1904', '1914', 'https://cite.case.law/mass/218/281/'],
     [inf, '1902', '1912', 'https://cite.case.law/ark/103/505/'],
     [inf, '1901', '1921', 'https://cite.case.law/kan/109/20/'],
     [inf, '1901', '1911', 'https://cite.case.law/kan/85/875/'],
     [inf, '1900', '1910', 'https://cite.case.law/sc/85/196/'],
     [inf, '1889', '1899', 'https://cite.case.law/tex-civ-app/21/613/'],
     [inf, '1889', '1899', 'https://cite.case.law/mo/152/560/'],
     [inf, '1889', '1899', 'https://cite.case.law/mo/148/665/'],
     [inf, '1889', '1899', 'https://cite.case.law/ill-app/81/605/'],
     [inf, '1889', '1899', 'https://cite.case.law/cal/124/422/'],
     [inf, '1889', '1899', 'https://cite.case.law/cal/124/42/'],
     [inf, '1889', '1899', 'https://cite.case.law/cal/124/406/'],
     [inf, '1888', '1988', 'https://cite.case.law/mich-app/173/188/'],
     [inf, '1886', '1896', 'https://cite.case.law/pa/173/28/'],
     [inf, '1886', '1896', 'https://cite.case.law/ny/150/566/2273965/'],
     [inf, '1886', '1896', 'https://cite.case.law/cal/111/25/'],
     [inf, '1885', '1895', 'https://cite.case.law/neb/44/73/'],
     [inf, '1885', '1895', 'https://cite.case.law/mo/130/621/'],
     [inf, '1885', '1895', 'https://cite.case.law/mo-app/63/492/'],
     [inf, '1884', '1894', 'https://cite.case.law/ohio-st-ns/51/575/932825/'],
     [inf, '1884', '1894', 'https://cite.case.law/mo-app/59/221/'],
     [inf, '1883', '1893', 'https://cite.case.law/misc/4/426/'],
     [inf, '1883', '1893', 'https://cite.case.law/misc/3/408/'],
     [inf, '1883', '1893', 'https://cite.case.law/minn/53/504/'],
     [inf, '1880', '1890', 'https://cite.case.law/wis/77/505/'],
     [inf, '1880', '1890', 'https://cite.case.law/ny/120/664/2231683/'],
     [inf, '1877', '1887', 'https://cite.case.law/us/120/73/'],
     [inf, '1876', '1896', 'https://cite.case.law/pa/173/15/'],
     [inf, '1869', '1896', 'https://cite.case.law/ad/8/619/2285964/'],
     [inf, '1866', '1876', 'https://cite.case.law/w-va/9/600/'],
     [inf, '1865', '1895', 'https://cite.case.law/pa/169/598/'],
     [inf, '1865', '1895', 'https://cite.case.law/ohio-st-ns/53/646/935869/'],
     [inf, '1864', '1964', 'https://cite.case.law/kan/193/97/'],
     [inf, '1864', '1874', 'https://cite.case.law/mass/115/578/'],
     [inf, '1862', '1872', 'https://cite.case.law/tex/35/797/'],
     [inf, '1861', '1891', 'https://cite.case.law/minn/47/527/'],
     [inf, '1855', '1885', 'https://cite.case.law/ill-app/17/663/867475/'],
     [inf, '1837', '1937', 'https://cite.case.law/cal-app-2d/21/540/'],
     [inf, '1834', '1884', 'https://cite.case.law/us/110/398/'],
     [inf, '1833', '1893', 'https://cite.case.law/ny-st-rptr/55/62/'],
     [inf, '1833', '1883', 'https://cite.case.law/ny/91/657/2188477/'],
     [inf, '1815', '1915', 'https://cite.case.law/ky/164/385/'],
     [inf, '1811', '1911', 'https://cite.case.law/misc/72/289/'],
     [inf, '1808', '1908', 'https://cite.case.law/misc/58/310/'],
     [inf, '1806', '1906', 'https://cite.case.law/ny/185/551/47756/'],
     [inf, '1800', '1890', 'https://cite.case.law/ny/123/463/'],
     [inf, '1714', '1914', 'https://cite.case.law/ad/161/883/2737575/'],
     [1599.94955752179, '1828', '1928', 'https://cite.case.law/fla/95/391/'],
     [1033.9636989610556, '1803', '1893', 'https://cite.case.law/cal/98/227/'],
     [1025.0417159008778, '1640', '1940', 'https://cite.case.law/f-supp/32/817/'],
     [738.7460150534026, '1825', '1925', 'https://cite.case.law/fla/91/272/'],
     [729.1291721956454, '1771', '1971', 'https://cite.case.law/ill-app-3d/2/538/'],
     [613.7805095623593, '1955', '1995', 'https://cite.case.law/wash-app/77/596/'],
     [611.8121668052878, '1901', '1961', 'https://cite.case.law/pr-dec/83/434/'],
     [576.557306990619, '1839', '1889', 'https://cite.case.law/cal/79/211/'],
     [559.4342257015245, '1641', '1941', 'https://cite.case.law/f-supp/42/135/'],
     [540.9460392602055,
      '1830',
      '1880',
      'https://cite.case.law/jones-and-spencers-super-ct-rep/14/577/1666618/'],
     [432.6511095255927, '1809', '1899', 'https://cite.case.law/f/108/469/'],
     [369.84508983221014, '1878', '1978', 'https://cite.case.law/misc-2d/96/393/'],
     [357.16827792981053,
      '1808',
      '1898',
      'https://cite.case.law/ga/105/499/391619/'],
     [349.9301146034497, '1933', '1983', 'https://cite.case.law/pa-commw/71/172/'],
     [311.16047063849965, '1804', '1894', 'https://cite.case.law/cal/102/537/'],
     [307.7682265114448, '1914', '1941', 'https://cite.case.law/fla/147/549/'],
     [253.04112746313047, '1828', '1928', 'https://cite.case.law/me/127/218/'],
     [248.54933481304474, '1819', '1919', 'https://cite.case.law/ny/227/184/'],
     [227.78415255464725, '1858', '1958', 'https://cite.case.law/kan/182/540/'],
     [226.216693024032, '1817', '1917', 'https://cite.case.law/ariz/18/503/'],
     [210.62600012013127, '1930', '1950', 'https://cite.case.law/so-2d/47/336/'],
     [208.70136095511245, '1868', '1898', 'https://cite.case.law/f/95/1000/'],
     [205.56918273148082, '1902', '1932', 'https://cite.case.law/nd/62/771/'],
     [205.56918273148082, '1902', '1932', 'https://cite.case.law/nd/62/767/'],
     [205.1751127250095,
      '1932',
      '1952',
      'https://cite.case.law/f2d/196/500/499344/'],
     [204.94064181285944, '1810', '1910', 'https://cite.case.law/ny-crim/25/173/'],
     [203.08709052185867, '1866', '1886', 'https://cite.case.law/mich/61/237/'],
     [200.45000000000084, '1903', '1913', 'https://cite.case.law/pr-dec/19/365/'],
     [197.22334142163575, '1822', '1882', 'https://cite.case.law/va/76/671/'],
     [194.09615605830578, '1807', '1897', 'https://cite.case.law/nd/7/109/'],
     [183.7657157791824, '1832', '1892', 'https://cite.case.law/nys/18/156/'],
     [175.711400095605, '1842', '1942', 'https://cite.case.law/frd/2/514/'],
     [164.90836822764487, '1930', '1960', 'https://cite.case.law/f2d/275/431/'],
     [159.62556235798266, '1963', '1973', 'https://cite.case.law/f2d/483/1392/'],
     [158.31421494389795, '1642', '1942', 'https://cite.case.law/f-supp/43/416/'],
     [144.10836200581846, '1936', '1956', 'https://cite.case.law/f-supp/145/756/'],
     [137.26162871312982,
      '1887',
      '1837',
      'https://cite.case.law/va/35/565/6718311/'],
     [136.37819909156045, '1718', '1818', 'https://cite.case.law/ky/8/393/'],
     [135.14014966586768, '1931', '1961', 'https://cite.case.law/f2d/288/683/'],
     [131.64525173057552, '2007', '2017', 'https://cite.case.law/f-appx/676/650/'],
     [126.801593317263,
      '1910',
      '1940',
      'https://cite.case.law/us/311/629/6148373/'],
     [120.40758455426905, '1945', '1965', 'https://cite.case.law/misc-2d/51/955/'],
     [119.08223449124712, '1886', '1896', 'https://cite.case.law/iowa/97/570/'],
     [113.05150532895549, '1875', '1885', 'https://cite.case.law/me/77/182/'],
     [105.86038353192727, '1836', '1886', 'https://cite.case.law/ga/78/89/'],
     [100.69417660321407,
      '1846',
      '1946',
      'https://cite.case.law/ohio-law-abs/46/198/'],
     [100.11111111111119, '1937', '1947', 'https://cite.case.law/tenn/186/459/'],
     [89.57812336032435, '1833', '1883', 'https://cite.case.law/conn/51/107/'],
     [88.38117971242372, '1879', '1899', 'https://cite.case.law/f/115/528/'],
     [86.12655692243149, '1913', '1943', 'https://cite.case.law/f-supp/50/221/'],
     [86.12655692243149, '1913', '1943', 'https://cite.case.law/f-supp/50/119/'],
     [83.48163537683081,
      '1855',
      '1885',
      'https://cite.case.law/how-pr/2/38/2290660/'],
     [80.58229473070615, '1913', '1953', 'https://cite.case.law/tex-crim/159/130/'],
     [80.36905724541667, '1917', '1947', 'https://cite.case.law/nc/227/716/'],
     [79.35741931287849,
      '1882',
      '1822',
      'https://cite.case.law/va/22/121/4443365/'],
     [76.90300935387457, '1912', '1952', 'https://cite.case.law/nd/78/1/'],
     [72.47762991162733, '1812', '1842', 'https://cite.case.law/va/40/268/'],
     [71.63544069548489, '1927', '1937', 'https://cite.case.law/miss/178/776/'],
     [70.60447722164773, '1910', '1940', 'https://cite.case.law/pr-dec/55/864/'],
     [69.4350958603334, '1819', '1879', 'https://cite.case.law/how-pr/58/167/'],
     [68.92973760113789,
      '1914',
      '1934',
      'https://cite.case.law/ohio-law-abs/15/113/'],
     [67.17148204409354, '1986', '1996', 'https://cite.case.law/br/189/769/'],
     [65.09276440998012,
      '1924',
      '1934',
      'https://cite.case.law/ohio-law-abs/20/448/'],
     [65.09276440998012,
      '1924',
      '1934',
      'https://cite.case.law/ohio-law-abs/20/432/1665958/'],
     [64.925662089779, '1885', '1895', 'https://cite.case.law/ind-app/13/446/'],
     [64.76825647185156, '1839', '1889', 'https://cite.case.law/ny/117/118/'],
     [64.24023579297378, '1911', '1941', 'https://cite.case.law/pr/59/274/'],
     [63.22106631342454,
      '1934',
      '1954',
      'https://cite.case.law/mass-app-dec/8/66/'],
     [63.22106631342454,
      '1934',
      '1954',
      'https://cite.case.law/mass-app-dec/8/62/'],
     [62.93250352560289, '1869', '1899', 'https://cite.case.law/us/172/557/'],
     [61.78086356126073, '1919', '1949', 'https://cite.case.law/wis/254/273/'],
     [60.99192537471873,
      '1966',
      '1996',
      'https://cite.case.law/wash-app/84/1015/121866/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/371/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/366/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/365/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/364/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/360/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/359/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/358/'],
     [60.95412386134485,
      '1883',
      '1833',
      'https://cite.case.law/wright/1/356/626153/'],
     [60.95412386134485,
      '1883',
      '1833',
      'https://cite.case.law/wright/1/356/625794/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/355/'],
     [60.95412386134485,
      '1883',
      '1833',
      'https://cite.case.law/wright/1/354/625994/'],
     [60.95412386134485,
      '1883',
      '1833',
      'https://cite.case.law/wright/1/354/625970/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/353/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/351/'],
     [60.95412386134485, '1883', '1833', 'https://cite.case.law/wright/1/350/'],
     [60.26896237771887, '1886', '1896', 'https://cite.case.law/tenn/96/249/'],
     [60.229940094343156, '1942', '1962', 'https://cite.case.law/misc-2d/34/496/'],
     [60.09635120846707, '2003', '2013', 'https://cite.case.law/sw3d/446/386/'],
     [59.95497451947758,
      '1957',
      '1975',
      'https://cite.case.law/sw2d/526/547/10129767/'],
     [59.05496009386771, '1923', '1953', 'https://cite.case.law/nd/79/591/'],
     [57.46821864166434, '1924', '1934', 'https://cite.case.law/fla/116/3/'],
     [54.98047028423875,
      '1941',
      '1951',
      'https://cite.case.law/f-supp/113/437/4232729/'],
     [54.451248484662614, '1929', '1939', 'https://cite.case.law/fla/140/176/'],
     [53.460527844225574, '1882', '1892', 'https://cite.case.law/ct-cl/27/221/'],
     [52.92785383058246, '1914', '1954', 'https://cite.case.law/misc-2d/15/831/'],
     [52.88418328862834, '1912', '1932', 'https://cite.case.law/nj-eq/112/308/'],
     [52.63671797535899, '1842', '1942', 'https://cite.case.law/f-supp/43/647/'],
     [51.95414400200691, '1873', '1893', 'https://cite.case.law/f/75/420/'],
     [51.59086935734964, '1931', '1941', 'https://cite.case.law/f-supp/47/710/'],
     [50.15025019292376, '1943', '1963', 'https://cite.case.law/misc-2d/53/786/'],
     [48.277294726361944, '1910', '1950', 'https://cite.case.law/misc-2d/9/209/'],
     [46.804422724886216, '1905', '1915', 'https://cite.case.law/f/232/613/'],
     [45.80786674510953, '1977', '1997', 'https://cite.case.law/vt/166/630/'],
     [45.199465642330146, '1879', '1897', 'https://cite.case.law/f/81/374/'],
     [45.145055192393436, '1876', '1896', 'https://cite.case.law/f/75/124/'],
     [45.11523706448452, '1909', '1919', 'https://cite.case.law/okla/78/44/'],
     [44.90144319163613, '1910', '1940', 'https://cite.case.law/f-supp/31/892/'],
     [43.41075236681166, '1854', '1864', 'https://cite.case.law/pa/47/367/'],
     [43.00494595923414, '1802', '1882', 'https://cite.case.law/f/89/582/'],
     [42.89524657405761, '1857', '1867', 'https://cite.case.law/pa/55/62/'],
     [41.85495047700621,
      '1876',
      '1886',
      'https://cite.case.law/ct-cl/21/126/3491807/'],
     [41.775413374692256, '1913', '1923', 'https://cite.case.law/f2d/1/323/'],
     [41.70348100421417, '1977', '1997', 'https://cite.case.law/vt/167/564/'],
     [41.60996194951719, '1928', '1948', 'https://cite.case.law/so-2d/38/397/'],
     [41.264977897513205,
      '1866',
      '1886',
      'https://cite.case.law/ny-st-rptr/5/144/'],
     [40.76734220520379,
      '1837',
      '1867',
      'https://cite.case.law/robertsons-super-ct-rep/4/449/'],
     [40.6678819814543,
      '2001',
      '2011',
      'https://cite.case.law/so-3d/110/574/7006169/'],
     [40.638855854539976, '1925', '1935', 'https://cite.case.law/okla-crim/62/30/'],
     [40.35682064128212, '1866', '1886', 'https://cite.case.law/va/82/567/'],
     [40.35382179982658, '1983', '1993', 'https://cite.case.law/sw2d/878/6/'],
     [39.71144521087414,
      '1886',
      '1896',
      'https://cite.case.law/ny-st-rptr/73/784/'],
     [39.083376074378585, '1977', '1997', 'https://cite.case.law/ga/267/515/'],
     [38.87555936359987,
      '1928',
      '1948',
      'https://cite.case.law/ohio-law-abs/57/374/'],
     [38.7362762334613, '1921', '1931', 'https://cite.case.law/f2d/58/981/'],
     [38.29107821199708, '1866', '1886', 'https://cite.case.law/va/81/473/'],
     [38.28193037490033, '1950', '1960', 'https://cite.case.law/ark/232/602/'],
     [38.05205898825713, '1882', '1892', 'https://cite.case.law/iowa/85/606/'],
     [38.05205898825713, '1882', '1892', 'https://cite.case.law/iowa/85/121/'],
     [37.771257790892975,
      '2002',
      '2012',
      'https://cite.case.law/f-supp-2d/925/1051/'],
     [37.30704444825586, '1929', '1949', 'https://cite.case.law/f-supp/82/910/'],
     [36.753279737032386,
      '1825',
      '1835',
      'https://cite.case.law/va/33/236/6717626/'],
     [35.571428571428704, '1991', '1981', 'https://cite.case.law/mont/194/173/'],
     [35.10128202786873, '1958', '1968', 'https://cite.case.law/colo/167/19/'],
     [34.87544620456475, '1951', '1961', 'https://cite.case.law/tex-crim/171/541/'],
     [34.49965392140595, '1901', '1921', 'https://cite.case.law/sw/236/763/'],
     [34.035171289108156, '1975', '1985', 'https://cite.case.law/br/75/707/'],
     [33.742055595198686, '2003', '2013', 'https://cite.case.law/frd/290/89/'],
     [33.57220108962965, '1907', '1917', 'https://cite.case.law/ind/186/88/'],
     [33.432123721829484, '1930', '1950', 'https://cite.case.law/f-supp/94/259/'],
     [33.078857784290875, '1908', '1918', 'https://cite.case.law/neb/102/654/'],
     [32.38067127185992, '1824', '1834', 'https://cite.case.law/wend/12/261/'],
     [32.258397323813874, '1832', '1852', 'https://cite.case.law/scl/40/521/'],
     [32.258397323813874, '1832', '1852', 'https://cite.case.law/scl/40/517/'],
     [32.258397323813874, '1832', '1852', 'https://cite.case.law/scl/40/515/'],
     [32.258397323813874, '1832', '1852', 'https://cite.case.law/scl/40/513/'],
     [32.258397323813874, '1832', '1852', 'https://cite.case.law/scl/40/511/'],
     [32.132029384224836,
      '1883',
      '1893',
      'https://cite.case.law/ct-cl/28/553/5648322/'],
     [31.62410346700247, '1954', '1964', 'https://cite.case.law/misc-2d/44/432/'],
     [30.98000595917896,
      '1871',
      '1881',
      'https://cite.case.law/jones-and-spencers-super-ct-rep/15/85/'],
     [30.30169726505179, '2003', '2013', 'https://cite.case.law/va-cir/88/423/'],
     [30.180682662059706,
      '2004',
      '2014',
      'https://cite.case.law/f-supp-3d/61/740/'],
     [29.85919336772895, '1957', '1967', 'https://cite.case.law/frd/42/390/'],
     [29.591130491072846, '1946', '1956', 'https://cite.case.law/f-supp/152/139/'],
     [29.591130491072846, '1946', '1956', 'https://cite.case.law/f-supp/152/136/'],
     [29.552789226174337, '1887', '1897', 'https://cite.case.law/ill-app/69/472/'],
     [29.552789226174337, '1887', '1897', 'https://cite.case.law/ill-app/69/441/'],
     [29.240940542168055, '1855', '1885', 'https://cite.case.law/ri/15/27/'],
     [29.197827595370576, '1886', '1896', 'https://cite.case.law/ind-app/15/639/'],
     [28.920015535580024, '1914', '1924', 'https://cite.case.law/f2d/9/183/'],
     [28.741319123295856, '1844', '1854', 'https://cite.case.law/tenn/33/629/'],
     [27.80176752496084, '1914', '1924', 'https://cite.case.law/okla/98/285/'],
     [27.43958486584799, '1907', '1917', 'https://cite.case.law/f/240/167/'],
     [27.28002932549764,
      '1837',
      '1827',
      'https://cite.case.law/va/26/453/6732940/'],
     [27.06188647953732, '1982', '1992', 'https://cite.case.law/va-cir/31/480/'],
     [26.915030012610224, '1880', '1890', 'https://cite.case.law/daly-ny/16/528/'],
     [26.38560213449732, '1817', '1827', 'https://cite.case.law/va/26/517/'],
     [26.345358163948834, '1885', '1895', 'https://cite.case.law/f/72/60/'],
     [25.96983218867709, '1905', '1915', 'https://cite.case.law/f/221/512/'],
     [25.573160372286225, '1883', '1893', 'https://cite.case.law/f/88/983/'],
     [25.573160372286225, '1883', '1893', 'https://cite.case.law/f/88/649/'],
     [25.483826708891716, '1909', '1919', 'https://cite.case.law/nd/44/367/'],
     [25.45584412271555, '1886', '1896', 'https://cite.case.law/ill-app/63/218/'],
     [25.310435170342373, '1913', '1923', 'https://cite.case.law/sw/248/816/'],
     [25.039994889896203, '1934', '1944', 'https://cite.case.law/ccpa/32/1228/'],
     [24.922849287390054, '1903', '1913', 'https://cite.case.law/f/225/511/'],
     [24.816915810487654,
      '1926',
      '1936',
      'https://cite.case.law/pr-dec/50/989/8807701/'],
     [24.777050354748596, '1869', '1879', 'https://cite.case.law/me/70/248/'],
     [24.67110097868956, '2000', '2010', 'https://cite.case.law/so-3d/127/225/'],
     [24.59859567314596, '1879', '1897', 'https://cite.case.law/ri/20/700/'],
     [24.175685473548334,
      '1882',
      '1892',
      'https://cite.case.law/jones-and-spencers-super-ct-rep/28/247/'],
     [23.991460593930057, '1938', '1948', 'https://cite.case.law/f-supp/83/914/'],
     [23.930207726180594, '1936', '1956', 'https://cite.case.law/misc-2d/14/203/'],
     [23.92110319534172,
      '1937',
      '1947',
      'https://cite.case.law/ohio-law-abs/55/398/'],
     [23.826028340359272, '1937', '1947', 'https://cite.case.law/f-supp/81/355/'],
     [23.697637799541074,
      '1851',
      '1861',
      'https://cite.case.law/luz-lo/1/356/11914315/'],
     [23.697637799541074,
      '1851',
      '1861',
      'https://cite.case.law/luz-lo/1/356/11914285/'],
     [23.697637799541074,
      '1851',
      '1861',
      'https://cite.case.law/luz-lo/1/356/11914265/'],
     [23.564130062121897, '1917', '1927', 'https://cite.case.law/misc/135/622/'],
     [23.498609634007334, '1861', '1881', 'https://cite.case.law/miss-dec/2/88/'],
     [23.410229280198358, '2005', '2015', 'https://cite.case.law/br/581/244/'],
     [23.166165021730475, '1862', '1852', 'https://cite.case.law/ny/6/144/'],
     [22.953170016730017, '1924', '1934', 'https://cite.case.law/okla/167/433/'],
     [22.823496347043385, '1904', '1914', 'https://cite.case.law/f/225/426/'],
     [22.80851077981376, '1877', '1887', 'https://cite.case.law/us/119/615/'],
     [22.65078257991276, '1964', '1974', 'https://cite.case.law/ark/255/1057/'],
     [22.64285714285701,
      '1815',
      '1825',
      'https://cite.case.law/va/24/191/6714889/'],
     [22.642452876596987,
      '1834',
      '1824',
      'https://cite.case.law/va/23/483/6715237/'],
     [22.627416997969682,
      '1963',
      '1973',
      'https://cite.case.law/ohio-app-2d/40/16/'],
     [22.621574485077474,
      '1826',
      '1836',
      'https://cite.case.law/whart/1/532/1831887/'],
     [22.621574485077474,
      '1826',
      '1836',
      'https://cite.case.law/whart/1/532/1829036/'],
     [22.537188933584915, '1935', '1945', 'https://cite.case.law/tenn/184/428/'],
     [22.535572433868307, '1943', '1953', 'https://cite.case.law/tenn-app/39/190/'],
     [22.44809249368186, '1886', '1896', 'https://cite.case.law/f/75/661/'],
     [22.387746802582786,
      '1927',
      '1937',
      'https://cite.case.law/pr-dec/50/981/8807192/'],
     [22.337037545543264, '1901', '1801', 'https://cite.case.law/va/7/25/'],
     [22.266358633980506, '1848', '1858', 'https://cite.case.law/ky/58/365/'],
     [22.219721754327164, '1931', '1941', 'https://cite.case.law/misc/179/1061/'],
     [22.166666666666874, '1929', '1939', 'https://cite.case.law/wis/233/54/'],
     [22.06175578346525, '1924', '1934', 'https://cite.case.law/kan/138/797/'],
     [21.920310216782813, '1887', '1897', 'https://cite.case.law/mich/115/340/'],
     [21.915253967989692, '1888', '1898', 'https://cite.case.law/or/33/578/'],
     [21.790407560591916, '1867', '1897', 'https://cite.case.law/nm/9/645/'],
     [21.582041418376303,
      '1879',
      '1897',
      'https://cite.case.law/ohio-cir-dec/7/411/'],
     [21.521658732155586,
      '1927',
      '1937',
      'https://cite.case.law/ala/235/696/5784293/'],
     [21.503488089145122, '1885', '1895', 'https://cite.case.law/mont/15/219/'],
     [21.497590608835786, '1924', '1934', 'https://cite.case.law/ohio-app/51/174/'],
     [21.497590608835786, '1924', '1934', 'https://cite.case.law/ohio-app/51/169/'],
     [21.38495264537003, '1936', '1946', 'https://cite.case.law/f-supp/75/683/'],
     [21.361959960016154,
      '1819',
      '1829',
      'https://cite.case.law/hall-super-ct-rep/1/655/'],
     [21.336260296624427,
      '1903',
      '1913',
      'https://cite.case.law/mont/48/619/2330847/'],
     [21.197613628175546, '1968', '1978', 'https://cite.case.law/f2d/589/957/'],
     [21.02036592275711, '1882', '1892', 'https://cite.case.law/va/89/507/'],
     [20.976613525979587, '1910', '1920', 'https://cite.case.law/njl/95/85/'],
     [20.940398336624668, '1938', '1958', 'https://cite.case.law/misc-2d/10/33/'],
     [20.882208321091948, '2004', '2014', 'https://cite.case.law/va-cir/89/446/'],
     [20.7414451562518, '1942', '1952', 'https://cite.case.law/ct-cl/121/891/'],
     [20.73956318261983, '1924', '1934', 'https://cite.case.law/sd/62/317/'],
     [20.629587959791948, '1939', '1959', 'https://cite.case.law/misc-2d/14/759/'],
     [20.38415644543814, '1955', '1965', 'https://cite.case.law/tenn/217/8/'],
     [20.31551231723678, '1807', '1867', 'https://cite.case.law/abb-ct-app/3/139/'],
     [20.295399129025483, '1846', '1856', 'https://cite.case.law/sc-eq/29/291/'],
     [20.249926513682233, '1874', '1884', 'https://cite.case.law/sc/20/503/'],
     [20.13625034213795, '1938', '1948', 'https://cite.case.law/f-supp/94/698/'],
     [20.108454164262294, '1943', '1953', 'https://cite.case.law/f-supp/118/272/'],
     [20.025360089171127, '1924', '1942', 'https://cite.case.law/f-supp/80/394/'],
     [19.93324981433143, '1915', '1925', 'https://cite.case.law/or/113/441/'],
     [19.874871035749067,
      '1988',
      '1998',
      'https://cite.case.law/f-supp-2d/34/550/'],
     [19.61038016738274, '1903', '1913', 'https://cite.case.law/sd/30/38/'],
     [19.271318609016866, '1885', '1895', 'https://cite.case.law/ind/143/488/'],
     [19.238869499449724, '1947', '1957', 'https://cite.case.law/me/152/464/'],
     [19.047088052388112,
      '1877',
      '1887',
      'https://cite.case.law/ny-st-rptr/5/585/'],
     [18.973910415036887, '1855', '1865', 'https://cite.case.law/pa/48/524/'],
     [18.95975079633342,
      '1841',
      '1851',
      'https://cite.case.law/sandford-super-ct-rep/5/256/'],
     [18.84250945216347, '1866', '1886', 'https://cite.case.law/ri/15/412/'],
     [18.84250945216347, '1866', '1886', 'https://cite.case.law/ri/15/302/'],
     [18.84250945216347, '1866', '1886', 'https://cite.case.law/ri/15/209/'],
     [18.784637218212314,
      '1854',
      '1864',
      'https://cite.case.law/robertsons-super-ct-rep/3/614/'],
     [18.730051116182516,
      '1935',
      '1945',
      'https://cite.case.law/f-supp/63/892/631473/'],
     [18.508580917173596,
      '1963',
      '1973',
      'https://cite.case.law/ohio-app-2d/33/121/'],
     [18.474266169676504,
      '1939',
      '1949',
      'https://cite.case.law/f-supp/94/245/1416366/'],
     [18.24138179749438, '1943', '1953', 'https://cite.case.law/misc/202/642/'],
     [18.212302416197467, '1909', '1919', 'https://cite.case.law/f/262/228/'],
     [17.931844207515535, '1953', '1963', 'https://cite.case.law/del/55/1/'],
     [17.871201816579998, '2008', '2018', 'https://cite.case.law/br/581/519/'],
     [17.774255525889327, '1944', '1954', 'https://cite.case.law/pa-d-c/88/292/'],
     [17.331137205379328, '1786', '1796', 'https://cite.case.law/va/6/412/'],
     [17.3289681934033, '1942', '1952', 'https://cite.case.law/misc-2d/14/128/'],
     [17.288850744230032, '1963', '1973', 'https://cite.case.law/pa-d-c2d/61/654/'],
     [17.12778741651188, '1943', '1953', 'https://cite.case.law/misc-2d/30/584/'],
     [16.900712467297062, '1864', '1874', 'https://cite.case.law/how-pr/48/257/'],
     [16.275146745002385,
      '1816',
      '1826',
      'https://cite.case.law/serg-rawle/12/435/'],
     [16.104719524109267, '2003', '2013', 'https://cite.case.law/sw3d/442/351/'],
     [15.726010170793645, '1882', '1842', 'https://cite.case.law/hay-haz/1/109/'],
     [15.553684912312594, '1852', '1862', 'https://cite.case.law/how-pr/32/341/'],
     [15.377340144773246, '1852', '1842', 'https://cite.case.law/hill-den/1/29/'],
     [15.128555015810864, '1944', '1954', 'https://cite.case.law/misc-2d/14/266/'],
     [14.9443855258549, '1941', '1951', 'https://cite.case.law/misc-2d/16/822/'],
     [14.9443855258549, '1941', '1951', 'https://cite.case.law/misc-2d/16/768/'],
     [14.9443855258549, '1941', '1951', 'https://cite.case.law/misc-2d/16/2/'],
     [14.773077811229633, '1853', '1863', 'https://cite.case.law/ct-cl/1/7/'],
     [14.732338600612058, '1864', '1874', 'https://cite.case.law/how-pr/50/415/'],
     [14.707359945522786,
      '1856',
      '1866',
      'https://cite.case.law/abb-pr/6/329/1960947/'],
     [14.670657669092202, '1886', '1896', 'https://cite.case.law/ri/19/724/'],
     [14.566955746993418, '1942', '1952', 'https://cite.case.law/alaska/13/194/'],
     [14.398396302568635, '1922', '1982', 'https://cite.case.law/va-cir/3/491/'],
     [14.34012358703439, '1849', '1879', 'https://cite.case.law/walker/3/497/'],
     [14.257579407367334, '1966', '1976', 'https://cite.case.law/pa-d-c3d/1/303/'],
     [14.125519234426225, '1898', '1988', 'https://cite.case.law/va-cir/13/536/'],
     [14.034800971969426,
      '1838',
      '1858',
      'https://cite.case.law/va/55/674/6732990/'],
     [13.689714724625253, '1887', '1897', 'https://cite.case.law/jahn/14/333/'],
     [13.401673514649849,
      '1855',
      '1865',
      'https://cite.case.law/how-pr/28/187/2221997/'],
     [13.401673514649849,
      '1855',
      '1865',
      'https://cite.case.law/how-pr/28/187/2220427/'],
     [13.221398052557738,
      '1897',
      '1887',
      'https://cite.case.law/ohio-cir-dec/1/526/'],
     [13.11175468539752,
      '1907',
      '1927',
      'https://cite.case.law/ill-app/245/636/3372136/'],
     [12.985752107039, '1858', '1868', 'https://cite.case.law/barb/50/32/'],
     [12.962352692606776, '1867', '1887', 'https://cite.case.law/haw/8/658/'],
     [12.856998512153993, '1927', '1937', 'https://cite.case.law/mo-app/232/417/'],
     [12.313820843947783, '1948', '1958', 'https://cite.case.law/misc-2d/30/127/'],
     [12.15496189758153, '1854', '1884', 'https://cite.case.law/walker/3/57/'],
     [12.15496189758153, '1854', '1884', 'https://cite.case.law/walker/3/54/'],
     [12.059444807692831,
      '1906',
      '1916',
      'https://cite.case.law/ohio-cc-ns/32/555/'],
     [12.055245637000501,
      '1957',
      '1967',
      'https://cite.case.law/conn-supp/26/450/'],
     [11.871110634774956, '1869', '1889', 'https://cite.case.law/haw/8/609/'],
     [11.845065583796126, '1858', '1868', 'https://cite.case.law/how-pr/35/184/'],
     [11.532317849097117, '1922', '1932', 'https://cite.case.law/del/35/76/'],
     [11.167260912593889, '1860', '1870', 'https://cite.case.law/barb/67/132/'],
     [11.100592523033091,
      '1985',
      '1995',
      'https://cite.case.law/ill-ct-cl/47/106/'],
     [11.054423074548804, '1828', '1858', 'https://cite.case.law/grant/2/388/'],
     [10.998948155975414, '1968', '1978', 'https://cite.case.law/ill-ct-cl/31/1/'],
     [10.931637495088466,
      '1919',
      '1929',
      'https://cite.case.law/ohio-np-ns/27/481/'],
     [10.907994130178597, '1875', '1885', 'https://cite.case.law/haw/5/675/'],
     [10.82762597182751, '1888', '1898', 'https://cite.case.law/ohio-np/8/627/'],
     [10.536071655718404,
      '1944',
      '1954',
      'https://cite.case.law/ohio-law-abs/74/337/'],
     [10.503807230236356,
      '1888',
      '1898',
      'https://cite.case.law/ohio-cir-dec/7/453/'],
     [10.169472463009074, '1948', '1958', 'https://cite.case.law/misc-2d/10/363/'],
     [9.89076811180347, '1936', '1946', 'https://cite.case.law/f-supp/80/79/'],
     [9.89076811180347, '1936', '1946', 'https://cite.case.law/f-supp/80/267/'],
     [9.89076811180347, '1936', '1946', 'https://cite.case.law/f-supp/80/266/'],
     [9.791376979574522, '1876', '1886', 'https://cite.case.law/haw/5/695/'],
     [9.596173499155052,
      '1888',
      '1898',
      'https://cite.case.law/jahn/20/707/1515720/'],
     [9.532767870238098, '1860', '1880', 'https://cite.case.law/walker/3/499/'],
     [9.16465788884263, '1760', '1790', 'https://cite.case.law/us/4/427/'],
     [9.109503326057686, '1857', '1867', 'https://cite.case.law/how-pr/34/418/'],
     [9.109503326057686, '1857', '1867', 'https://cite.case.law/how-pr/34/239/'],
     [8.790352183953367,
      '1887',
      '1897',
      'https://cite.case.law/ohio-np/5/247/1528095/'],
     [8.790352183953367,
      '1887',
      '1897',
      'https://cite.case.law/ohio-np/5/247/1527965/'],
     [8.479099650403226, '1888', '1898', 'https://cite.case.law/jahn/22/630/'],
     [8.15217759589184, '1784', '1794', 'https://cite.case.law/va/1/368/'],
     [8.050133530403317, '1949', '1959', 'https://cite.case.law/misc-2d/16/9/'],
     [8.050133530403317, '1949', '1959', 'https://cite.case.law/misc-2d/16/72/'],
     [8.050133530403317, '1949', '1959', 'https://cite.case.law/misc-2d/16/10/'],
     [7.852282046216471, '1825', '1835', 'https://cite.case.law/miles/1/357/'],
     [7.59438126944334, '1851', '1871', 'https://cite.case.law/barb/63/60/'],
     [7.089818955123682, '1861', '1881', 'https://cite.case.law/walk/4/426/'],
     [6.48718674285974, '1827', '1837', 'https://cite.case.law/sc-eq/16/459/'],
     [6.422605694618546, '1863', '1883', 'https://cite.case.law/walk/4/28/'],
     [6.414900345615853, '1879', '1889', 'https://cite.case.law/haw/8/627/'],
     [6.117300056335036, '1858', '1868', 'https://cite.case.law/barb/66/310/'],
     [6.117300056335036, '1858', '1868', 'https://cite.case.law/barb/66/160/'],
     [5.827403625027077, '1885', '1895', 'https://cite.case.law/jahn/18/814/'],
     [5.827403625027077, '1885', '1895', 'https://cite.case.law/jahn/18/790/'],
     [5.282092414747416, '1939', '1919', 'https://cite.case.law/balt-c-rep/4/21/'],
     [3.7822192802685084, '1781', '1871', 'https://cite.case.law/f-cas/5/1056/'],
     [3.7370671544160294, '1816', '1826', 'https://cite.case.law/del-cas/3/227/'],
     [3.556758279554999, '1779', '1879', 'https://cite.case.law/f-cas/8/975/'],
     [3.4364673943150845, '1788', '1878', 'https://cite.case.law/f-cas/5/13/'],
     [3.2506909297445823, '1782', '1872', 'https://cite.case.law/f-cas/14/164/'],
     [3.2506909297445823, '1782', '1872', 'https://cite.case.law/f-cas/14/163/'],
     [3.1449321943600546, '1786', '1876', 'https://cite.case.law/f-cas/9/406/']]
    {'too_many': 524, 'not_enough': 596, 'matched': 430, 'too_close': 186}
    
    点赞 评论 复制链接分享
  • weixin_39574065 weixin_39574065 5月前

    At 's suggestion, I ran a report that checked to see if the decision date was outside of other date ranges we had for that book. I took the spine start/end years, page start/end years, and the other start/end year values for each volume, found the extreme values among them that were between 1600 and 2020, and looked for cases with decision dates outside of those ranges. It looks like there are a lot of volumes (16,807) that have cases outside of those dates, and all of the ones in the sample I took seemed to not be mistakes. 210 books didn't seem to have good values at all for the start/end years.

    32044057890105 start: 1875 end: 1876:

    Screen Shot 2020-04-01 at 8 15 36 AM

    32044078531571 start: 1996 end: 1996:

    Screen Shot 2020-04-01 at 8 16 00 AM

    32044078566718 start: 1945 end: 1945:

    Screen Shot 2020-04-01 at 8 18 48 AM

    I'm going to make a subsequent report that uses this as an initial filter to see if I can narrow down my purely statistical report.

    点赞 评论 复制链接分享
  • weixin_39873456 weixin_39873456 5月前

    FWIW, we're working on adding per-volume date information to the reporter DB at some point sorta soon, I think: https://github.com/freelawproject/reporters-db/issues/19

    The underlying goal is to be able to look up reporter citations that lack page numbers, like, 444 U.S. ____

    点赞 评论 复制链接分享
  • weixin_39574065 weixin_39574065 5月前

    Thanks . Just subscribed to that thread.

    点赞 评论 复制链接分享
  • weixin_39574065 weixin_39574065 5月前

    Going to do one pass with only volumes that have cases with decision dates greater than the publication date, then for the rest, do the statistical analysis in the other report, maybe with the spine/etc. dates as a selection criteria.

    点赞 评论 复制链接分享
  • weixin_39873456 weixin_39873456 5月前

    Familiar. FWIW, we have code to catch transposed digits in years when we scrape, which automatically corrects errors like:

    2109

    Instead of:

    2019

    That accounts for a fair number of these we've seen in the wild. Happy to share if useful.

    点赞 评论 复制链接分享
  • weixin_39873456 weixin_39873456 5月前

    OK, I know I'm replying to myself, but we actually have an issue for this too. I wonder if we talked about this. Ours is here: https://github.com/freelawproject/courtlistener/issues/592, so I'm mostly just connecting things. If one of us tackles this, I suspect there will be useful things for the other.

    点赞 评论 复制链接分享
  • weixin_39574065 weixin_39574065 5月前

    missing_jurisdiction_updated.xlsx

    Here's my first pass at identifying outlier years. I ended up looking at the standard deviation of the interval between years to find ones with very different intervals, and then calculated the z-score of each year to get the outliers. I'm not a statistics guy, but it looks like a good first pass.

    点赞 评论 复制链接分享
  • weixin_39873456 weixin_39873456 5月前

    Wow, that's a remarkably and wonderfully short list. Do you have code of your stats work somewhere,

    点赞 评论 复制链接分享
  • weixin_39574065 weixin_39574065 5月前

    Ha, misdrag-and-drop. Sorry about that!

    427_decision_outliers.xlsx

    点赞 评论 复制链接分享

相关推荐