Author Topic: Identical wpt files  (Read 238 times)

0 Members and 1 Guest are viewing this topic.

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 864
  • Last Login:Today at 09:56:44 pm
Identical wpt files
« on: March 01, 2017, 12:06:53 am »
Discussion in the canbc thread about keeping identical files in sync got me wondering about how many routes are entirely duplicated in multiple systems.  The list is below, minus a ton of empty files I wish were not in the repository.  Some are clearly intentionally copies, but I think some others are duplicated unintentionally.  In any case, given the number of such pairs of files, I think it might be worth investigating a mechanism to enforce that these files remain identical, or at least trigger some kind of warning if they stop being identical.

Code: [Select]
./WI/usausb/wi.wi026busjef.wpt         
./WI/usawi/wi.wi026busjef.wpt

./WI/usausb/wi.wi026busfor.wpt
./WI/usawi/wi.wi026busfor.wpt

./WI/usausb/wi.wi013busmar.wpt
./WI/usawi/wi.wi013busmar.wpt

./WI/usausb/wi.wi011busmon.wpt
./WI/usawi/wi.wi011busmon.wpt

./VA/usava/va.va195.wpt
./VA/usansf/va.va195.wpt

./VA/usava/va.va150.wpt
./VA/usansf/va.va150.wpt

./VA/usava/va.va146.wpt
./VA/usansf/va.va146.wpt

./VA/usava/va.va110.wpt
./VA/usansf/va.va110.wpt

./VA/usava/va.va037.wpt
./VA/usansf/va.va037.wpt

./VA/usausb/va.us340lou.wpt
./VA/usaus/va.us340lou.wpt

./UKR/eursf/ukr.avtkhadni.wpt
./UKR/ukrm/ukr.m029.wpt

./UKR/eure/ukr.e87ode.wpt
./UKR/ukrm/ukr.m015ode.wpt

./SWE/eursf/swe.nynvag.wpt
./SWE/swer/swe.r073.wpt

./SWE/eursf/swe.norled.wpt
./SWE/swel/swe.l265.wpt

./SWE/eursf/swe.arslan.wpt
./SWE/swer/swe.r075.wpt

./SVN/eure/svn.e653.wpt
./SVN/svna/svn.a005.wpt

./SRB/eure/srb.e65.wpt
./SRB/eure/srb.e80rib.wpt

./SD/usausb/sd.us016trkhil.wpt
./SD/usausb/sd.us385trkhil.wpt

./SCT/gbrtr/sct.borhistr.wpt
./SCT/gbna/sct.a0007.wpt

./SC/usausb/sc.us021concol.wpt
./SC/usausb/sc.us076concol.wpt

./SC/usaif/sc.i074futmyr.wpt
./SC/usansf/sc.sc031.wpt
./SC/usasc/sc.sc031.wpt

./RUS/rusr/rus.r256.wpt
./RUS/asiahr/rus.ah004.wpt

./RUS/rusm/rus.m011.wpt
./RUS/eursf/rus.skoavtvvo.wpt

./RUS/rusa/rus.a322.wpt
./RUS/asiah/rus.ah064.wpt

./RUS/eursf/rus.skoavt.wpt
./RUS/rusm/rus.m011mos.wpt

./RUS/eure/rus.e95.wpt
./RUS/rusr/rus.r023.wpt

./RUS/eure/rus.e127.wpt
./RUS/rusa/rus.a320.wpt
./RUS/asiah/rus.ah060.wpt

./RUS/eure/rus.e121.wpt
./RUS/asiah/rus.ah063.wpt

./RUS/eure/rus.e101.wpt
./RUS/rusm/rus.m003.wpt

./RUS/asiahp/rus.ah031.wpt
./RUS/rusr/rus.r297bla.wpt

./ROU/eure/rou.e771.wpt
./ROU/roudn/rou.dn06a.wpt

./ROU/eure/rou.e675.wpt
./ROU/roudn/rou.dn038.wpt

./PRT/eure/prt.e806.wpt
./PRT/prta/prt.a023.wpt

./PE/canpe/pe.pe001.wpt
./PE/cantch/pe.tchpei.wpt

./ON/canon/on.on017aken.wpt
./ON/cantch/on.tchken.wpt

./ON/cannf/on.garexpy.wpt
./ON/canonf/on.ongar.wpt

./ON/cannf/on.donvalpkwy.wpt
./ON/canonf/on.ondvp.wpt

./NY/usausb/ny.us006altgar.wpt
./NY/usausb/ny.us202altgar.wpt

./NY/usai/ny.i086.wpt
./NY/usany/ny.ny017.wpt

./NV/usausb/nv.us395altple.wpt
./NV/usausb/nv.us395altwas.wpt

./NS/cannst/ns.ns008.wpt
./NS/cannss/ns.kejscedr.wpt

./NS/cannst/ns.ns006.wpt
./NS/cannss/ns.suntrlamh.wpt

./NS/cannsc/ns.ns366.wpt
./NS/cannss/ns.suntrltid.wpt

./NPL/asiahp/npl.ah002.wpt
./NPL/nplh/npl.h001.wpt

./NM/usaus/nm.us062.wpt
./NM/usaus/nm.us180car.wpt

./NM/usaus/nm.us056.wpt
./NM/usaus/nm.us412.wpt

./NLD/nlda/nld.a010.wpt
./NLD/nldrw/nld.ringams.wpt

./NL/cantch/nl.tchmai.wpt
./NL/cannl/nl.nl001.wpt

./ND/usausb/nd.us002buswil.wpt
./ND/usausb/nd.us085buswil.wpt

./NC/usaif/nc.i295futfay.wpt
./NC/usanc/nc.nc295.wpt

./NB/cannb/nb.nb016.wpt
./NB/cantch/nb.tchpei.wpt

./NB/cannb/nb.nb002.wpt
./NB/cantch/nb.tchmai.wpt

./MO/usaus/mo.us166.wpt
./MO/usaus/mo.us400.wpt

./MNE/eure/mne.e65.wpt
./MNE/eure/mne.e80.wpt

./MEX-ZAC/mexd/mexzac.mex045dvic.wpt
./MEX-ZAC/mexd/mexzac.mex049dvic.wpt

./MEX-ZAC/mexd/mexzac.mex045dfre.wpt
./MEX-ZAC/mexd/mexzac.mex049dfre.wpt

./KGZ/eure/kgz.e40.wpt
./KGZ/kgzem/kgz.em01.wpt

./KAZ/kaza/kaz.a024.wpt
./KAZ/asiah/kaz.ah061mar.wpt

./KAZ/eure/kaz.e011.wpt
./KAZ/kaza/kaz.a006.wpt

./KAZ/cism/kaz.m051.wpt
./KAZ/asiah/kaz.ah006.wpt

./ITA/eure/ita.e842.wpt
./ITA/itaa/ita.a016.wpt

./IND-PB/asiahp/indpb.ah001.wpt
./IND-PB/asiahp/indpb.ah002.wpt

./IND-NL/asiahp/indnl.ah001.wpt
./IND-NL/asiahp/indnl.ah002.wpt

./IND-MN/asiahp/indmn.ah001.wpt
./IND-MN/asiahp/indmn.ah002.wpt

./IND-ML/asiahp/indml.ah001.wpt
./IND-ML/asiahp/indml.ah002.wpt

./IND-HR/asiahp/indhr.ah001.wpt
./IND-HR/asiahp/indhr.ah002.wpt

./IND-AS/asiahp/indas.ah001.wpt
./IND-AS/asiahp/indas.ah002.wpt

./IN/usaif/in.i265futlou.wpt
./IN/usain/in.in265.wpt

./IL/usaus/il.us060.wpt
./IL/usaus/il.us062.wpt

./HRV/eure/hrv.e73plo.wpt
./HRV/hrvd/hrv.d009.wpt

./HRV/eure/hrv.e661.wpt
./HRV/hrvd/hrv.d005.wpt

./HRV/eure/hrv.e65dub.wpt
./HRV/hrvd/hrv.d008dub.wpt

./HKG/hkgrt/hkg.rt008.wpt
./HKG/asiahp/hkg.ah368.wpt

./GEO/eure/geo.e001.wpt
./GEO/geos/geo.s007.wpt

./FL/usafl/fl.fl595.wpt
./FL/usausb/fl.us019altstp.wpt

./ENG/gbna/eng.a5087.wpt
./ENG/gbrtr/eng.lowfurcr.wpt

./DNK/eursf/dnk.fsundmot.wpt
./DNK/dnkpr/dnk.pr17.wpt

./DEU/eure/deu.e641.wpt
./DEU/deub/deu.b021.wpt

./DC/usai/dc.i095.wpt
./DC/usai/dc.i495.wpt

./CHN-ZJ/asiahp/chnzj.ah003.wpt
./CHN-ZJ/chng/chnzj.g60.wpt

./CHN-SH/asiahp/chnsh.ah005.wpt
./CHN-SH/chng/chnsh.g42.wpt

./CHN-SH/asiahp/chnsh.ah003.wpt
./CHN-SH/chng/chnsh.g60.wpt

./CHN-JX/asiahp/chnjx.ah003.wpt
./CHN-JX/chng/chnjx.g60.wpt

./CHN-JS/asiahp/chnjs.ah034.wpt
./CHN-JS/chng/chnjs.g30.wpt

./CHN-HN/asiahp/chnhn.ah003.wpt
./CHN-HN/chng/chnhn.g60.wpt

./CHN-HN/asiahp/chnhn.ah001.wpt
./CHN-HN/chng/chnhn.g04.wpt

./CHN-HE/asiahp/chnhe.ah001.wpt
./CHN-HE/chng/chnhe.g04.wpt

./CHN-HB/asiahp/chnhb.ah001.wpt
./CHN-HB/chng/chnhb.g04.wpt

./CHN-HA/asiahp/chnha.ah005.wpt
./CHN-HA/chng/chnha.g40.wpt

./CHN-HA/asiahp/chnha.ah001.wpt
./CHN-HA/chng/chnha.g04.wpt

./CHN-GZ/asiahp/chngz.ah003.wpt
./CHN-GZ/chng/chngz.g60.wpt

./CHN-GS/asiahp/chngs.ah005.wpt
./CHN-GS/chng/chngs.g30.wpt

./CHN-AH/asiahp/chnah.ah034.wpt
./CHN-AH/chng/chnah.g30.wpt

./CHN-AH/asiahp/chnah.ah005.wpt
./CHN-AH/chng/chnah.g40.wpt

./CHE/chea/che.a002.wpt
./CHE/eure/che.e35.wpt

./BLR/blrm/blr.m014.wpt
./BLR/eursf/blr.mkad2.wpt

./BLR/blrm/blr.m009.wpt
./BLR/eursf/blr.mkad.wpt

./BIH/eure/bih.e65.wpt
./BIH/bihm/bih.m002.wpt

./BC/cantch/bc.tchyel.wpt
./BC/canbc/bc.bc016.wpt

./BC/cantch/bc.tchhai.wpt
./BC/canbc/bc.bc016hai.wpt

./BC/cantch/bc.tchbuscha.wpt
./BC/canbc/bc.bc001buscha.wpt

./AUT/others/aut.grohocstr.wpt
./AUT/others/aut.silhocstr.wpt

./AUT/autb/aut.b320.wpt
./AUT/eure/aut.e651.wpt

./AB/canab/ab.ab016.wpt
./AB/cantch/ab.tchyel.wpt

./AB/canab/ab.ab001.wpt
./AB/cantch/ab.tchmai.wpt

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 864
  • Last Login:Today at 09:56:44 pm
Re: Identical wpt files
« Reply #1 on: March 01, 2017, 12:10:49 am »
Quick aside on this: Unix wins again with the excellent "fdupes" command that found all matches among 30,000+ wpt files in well under a minute.

Offline dfilpus

  • Newbie
  • *
  • Posts: 46
  • Gender: Male
  • Last Login:Today at 09:59:13 pm
    • Filpus Roadgeek
Re: Identical wpt files
« Reply #2 on: March 01, 2017, 11:45:46 am »
Why are Wisconsin State Highway Business Route files even in usausb?

Offline yakra

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 971
  • Last Login:Today at 12:35:39 am
Re: Identical wpt files
« Reply #3 on: March 06, 2017, 01:45:07 am »
Quote
./NY/usausb/ny.us006altgar.wpt
./NY/usausb/ny.us202altgar.wpt
https://github.com/TravelMapping/HighwayData/pull/1143