MAPS-CD.txt 7.4a   HOW TO BUILD APRS MAPS FROM THE USGS CD ROM    2 Nov 95


SUMMARY:  There are three other important MAP README's.  MAPS.txt is the 
overview and tells how maps are distributed.  MAPMAKIN.txt describes the 
format of APRS maps and how to make them and MAPS-HST tells you how to make 
maps simply by driving and saving a track history!  But NOW we can make
maps directly from the USGS CD ROMS!

MKMAPHK1:  KB4XF has written MKMAPHK1.EXE which will generate street 
           level maps from the USGS 100K CD ROM in one BIG step.!
           SEE MKMAPHK1.TXT !  With this program, anyone can make
           street level maps anywhere in the USA!

MAKEMAP1:  This program by KB4XF can make a 2,000,000:1 map in a single
           step.  See the 32 mile map in North Tennessee. 
             
OVERVIEW:  There are two areas of CDROM map development ongoing in the 
APRS community.  One is using MAKEMAP1.EXE to build big 32 mile maps
from the 2,000,000 CD ROM data.  THese will have MAJOR roads, railroads
rivers and streams and county lines on a typical 32 mile scale.  The 
other is using the 100K CD data for making 2 and 4 mile detail maps of
city streets.  Notice that using 100K data to make maps larger than
4 miles generates TOO many points, and using 2,000,000 data below about
32 miles gives too little.  For most mobile applications, steet level 
detail is NOT needed, considering that your radio range is 20 miles or
more using digipeaters.

     There are 3 problems with the USGS data that causes excessive
points in an APRS map.  First, lines begin and end at EACH intersection.  
Second, these short segments are not always consecutive in the file, and 
Third, the USGS data guarantees 100 points to the inch at the original 
map scale (1/3 mile for the 64 mile maps) whether it is needed or not.  
A 10 mile long straight road is stored as 30 points in USGS vice 2 points 
in APRS.  At the 100,000:1 scale, this puts a point every 100 feet!


BIG MAPS:  Information on using the original 2,000,000:1 USGS CD ROM has
been moved to the end of this file, since by now, (fall 94) almost all
of the US population centers have at least the ROADS from this data base.
The 2,000,000 is also still useful for making 30 mile maps bringing in
all of the rivers, streams, county lines, and railroads.  You will not gain
any more roads than what is already in most APRS 64 mile maps, but the 
other features can make a more colorful and geographically filled map.


DETAIL STREETS:  Making APRS maps from the 100,000:1 USGS CD ROMS is now
EASY!  Use KB4XF's MKMAPHK1.EXE and get a copy of the $32 CD ROM from
USGS that covers your area.  USGS sells 13 diferent 100K CD's.  To see 
which CD covers your area, hit the 1 KEY on your APRS screen to get to 
the whole USA map.  Then press the MAPS-ALT command to see the CD.map 
which is under the USA map.  This display shows you the areas of the 
13 different ROMS.   To obtain one of these CD ROMS, send $32 each 
plus $3.50 per order to the USGS Earth Science Info Center, 507  National 
Center, Reston, VA 22092.  BE SURE TO SPECIFY THE Digital Line Graph 
(DLG) 100,000 OPTIONAL format and the correct ROM for your area.
  
Useful phone info numbers.  But you may as well skip right to the FAX,
or mail them a check.
  703-648-6045 AND 1-800-USA-MAPS - VoiceMail INFO
  800-435-7627 - A real HUMAN (and the old fashoned HOLD)
  303-202-4693 - FAX will accept credit card orders 

To beat the 2 to 4 week delivery times promised by the Government, you can
also call MAP Express 1-800-627-0039 and pay $38 for the ROM plus $5
handling and get it faster.  THey will also FEDEX it too...



HOW TO BUILD A MAP FROM THE USGS 100K DETAIL CD ROMS

MKMAPHK1.EXE:  This program is a ONE STEP process for generating street 
level maps of your area from the 100K CD rom for your region.  It
was written by KB4XF and GREATLY simplifies what had been a LABORIOUS
process.  It still takes a lot of manual effort to smooth the map down
to the final 3000 point APRS limit and to add map labels, but the effort 
is WORTH IT!  This program obsoletes most of the rest of this file!
See MKMAPHK1.txt on how to use it.  AND IGNORE THE REST OF THIS FILE.


CONV100c.bas:  The original APRS MAPFIX.bas could build an APRS map from
the separate files generated by the USGS XTRACT.EXE program provided on
the 2,000,000 CD ROM.  To take advantage of the MAPFIX.bas utility,
W7KKE wrote a program called CONV100c.bas which takes data from the
100K scale CD ROMS and generates DOS files that 'look like' they came 
from the 2,000,000 data and therefore usable in MAPFIX.  Here are the
steps involved (obsolete now due MKMAPHK1):

1.  Run the USGS EXTRACT program and follow its instructions to output the
appropriate map data for the 15 x 15 minute area that you are interested in.
These files will be of the form XXXRDSnn for ROADS and xxxHYFnn for hydro
where the nn is for multiple files to cover the area.  There will be lots
of ROADS files.

2.  Run CONV100c.bas and once you give it one of the above file names, it 
will automatically generate a series of 10 output files of the form 
PREnRD.GRF for n different ROAD files and two other files preWB.grf and 
preST.grf for waterbodies and streams.  CONV100c outputs these files in 
the same format as the original 2,000,000 that MAPFIX knows how to read.  
The PRE is a 3 or 4 letter prefix that you specify for this series to help
you keep track of all the files.  So far, the number 4, 9 and 10 maps in 
my area have been empty... but the pre8RD.GRF file is the largest by a 
factor of ten!  It contains all of the neighborhood streets.

3.  Run MAPFIX and load an existing APRS map that covers the area where
you will be working.  This map just makes it easy to visually get the
cursor to the right area.  Once you hit the ALT-U commmand, this existing
MAP is no longer used.  MOve the cursor to the center of the map you want
to make, and hit the B command to establish the boundary of the area
that you want to develop.  Choose a scale of  3000, 4500, 6000 or 9000 
that will cover the total area you eventually want covered.  Next use the 
alt-USGS command to bring in the first of the above files.  Then do the 
alt-SCRUNCH and the alt-JOIN commands to minimize the map.  Then SAVE IT 
WITH A NEW NAME.  Then repeat this step for all the maps that were output 
from the CONV100c.bas program.  After you have saved each of these, you 
will now have almost a dozen maps each containing a different feature, 
but in APRS format.

WARNING!:  NEVER do a second ALT-U USGS BUILD on the same map, because it
will clear all current points and start a new map from scratch.

4.  Next, run Ken's DEFRAG.bas program on EACH of the files generated by
MAPFIX in the above step 3 to try to reduce the number of points.  You
may see a 20% or more reduction in points.  Re-save each of these reduced
maps under a new name so that you do not distroy your originals.

NOTE:  Be sure to also review the steps at the end of this file on how 
MAPFIX is used to read the 2,000,000:1 CD ROMS, since that process was
developed first and is the basis for MAPFIX routines.  W7KKE's
CONV100c.bas program simply puts the 100,000:1 OPTIONAL data format 
into the GRAPHICS format which is then readable my MAPFIX.bas.

5.  Now, combine these maps into one APRS map, using the MAPFIX alt-IMPORT
command.  This command will bring just one, or all of the map features of one
file into the current file.  In an urban area, the level 8 road file will be
larger than all the others combined.  You can omit it to allow your map to
cover a larger area or include it for the finest detail available.  BE SURE
to have the alt-RANGE box LARGE enough since only points in the box will
be IMPORTED.

Good luck.  For more detail on the use of MAPFIX with CD ROMs, also read 
the 2,000,000:1 section below, since it evolved and was the basis for APRS 
maps before we began messing with the 100,000:1 data.

----------------------------------------------------------------------------

PROCEDURES FOR 2,000,000:1 CD ROM THAT COVERS THE WHOLE US


Most of the initial 64 mile and larger maps were made by XTRACTING only the
ROADS from this CD.  But NOW (May 95) we have the new MAKEMAP1.bas program
which makes these 2,000,000 type maps (including county lines and streams 
and railraods) relatively easily but only for maps about 32 miles in size.  
The first such new map that includes ALL features on the 2,000,000 CD is 
in the N. Tennessee map, TNnorth.map.   

MAKEMAP1.BAS  The new precedure uses the MAKEMAP program by KB4XF that 
XTRACTS data directly from the CD and saves it in APRS format.  
Simply choose the state and specify a LAT/LONG and range for the center 
of the map.  By choosing a small enough area (30 miles or so in the east, 
maybe 50 or more in the rural west) you get a resulting map with about 4 
to 5000 points.  THen load this into MAPFIX and use the alt-SCRUNCH command 
and finally go through each point and use alt-DELETE to get the number of 
points below 3000.  This is a nice painless process.  But remember that 
the detail on the 2,000,000 CD ROM is about the same (or worse) as looking 
at a typical state highway  map through a magnifying glass!!!


USGSMAP1.BAS:  This is a modified version of MAKEMAP1.bas by Dan Reilly,
W4NMK in North Carolina which will work directly on USGS files obtained 
over the internet.  Get these maps from: 

http;//edcftp.cr.usgs.gov/pub/data/DLG/2M/{area of interest}
      /{transportation/hydrographic/political/railroads}/

Chose the area of interest and the features from the menu.  You will then 
generate ROADS.GRA, WATER_BO.GRA, STREAMS.GRA, POLITICA.GRA and RAILROAD.
GRA.  Combine these all into one file.  One way is with the COPY command:

Copy ROADS.GRA+WATER_BO.GRA+STREAMS.GRA+POLITICA.GRA+RAILROAD.GRA ALLSTUFF.GRA

Where the file named ALLSTUFF will be your new source file.  Then follow
the instructions in the program (just like MAKEMAP1).



OLD MAPFIX METHOD:  The following STEPS outline the older method which is 
pretty obsolete.  This method uses the USGS XTRACT.EXE program to extract 
separate files for each of the major map categories of features.  Then you
use MAPFIX multiple times to combine the individual features.

1.  Use USGS XTRACT.EXE program to extract the 2M CD ROM data in the GRAPHIC 
format for your area.  Then select up to 6 categories for extraction onto 
your HARD disk, one for each of the data types, Political BOUNDARIES, ROADS, 
etc.  These files will take about 5 to 10 MBytes.  Note the filenames.

2.  Run MAPFIX.BAS program and load the best existing APRS map that covers
the desired area.  This map is only used to help you locate the area of
interest.  Next, move the cursor to the center of interest and select
a SCALE using the BOUNDARY (B) command.  This command will show you the
maximum map possible for a given scale in Points/per degree.  I have found
600 to be about right.  450 in sparse states and 300 in UTAH and NEW Mex.
If you use any less, to get larger maps, you will end up with far too many
points.  I used 900 for a 35 mile map around Philadelphia.  Making smaller 
maps is probably not worth the effort, since there will be so few roads in it..

3.  After using the B command to get the right Pixels-per-degree, press 
the alt-U key.  MAPFIX will allow you to round the ORIGIN values, to 
reasonable nearly whole numbers or fractions of a degree so that later 
manual operations with a map and ruler will have round numbers 
to deal with.

4.  You do one type of data at a time.  MAPFIX asks you for the type of 
file (RD, ST, WB, etc) and then the exact path to the XTRACTed USGS data.  
This path should include the first part ot the filename up to the (_) 
underline that separates the RD or WB etc final two characters.  On my 
system it is usually D:\NEAST\S01_  and then MAPFIX adds the RD.GRF on 
the end.  MAPFIX will then scan the entire indicated file for all points 
within the selected border.  While converting the points to APRS format, 
MAPFIX will also compare the slope of each new point with the previous 
point and ignore the point if it has approximately the same slope, 
(within 1.2).  The total number of points will be from 2000 to 4000.

5.  Next use the alt-JOIN command which will scan through the map 
looking for consecutive features that end and then start at the same 
point.  This will save ONE point for each such joining.

6.  Next use the MAPFIX alt-SCRUNCHER command which will run another slope
comparison.  You can select the SCRUNCHER factor.  A factor of 1 will only
throw out points that are exactly the same slope (few if any).  A factor of
1.2 (best) will throw out points whose slope differs by less than 1.2.
Bigger values will throw out more points and will tend to make shortcuts 
out of any long slow curves.  Anything above 1.5 should be avoided.  The
safest approach is to do the alt-SCRUNCH at 1.1 twice, and then if needed
to it again at 1.2.

7.  At this point, save the map using Ctrl-S giving it a name which
includes the feature type (..RD, ..ST, ..WB, etc)  As long as you have not
hit the SPACE bar or changed scales, the original MAP which was used for
oreintation will still be on the screen with all the new dots.  This map is
NOT involved at all, but is still on the screen.  Be sure you have saved
the new map points; and then hit alt-U again to do the process again for
another feature type (RD, WB, ST, etc).  If you have not changed anything
your ORIGIN values will be reused again.

8.  Repeat steps 3 through 7 for all 6 data types, being sure to SAVE each
type separately, but without re-drawing the map.  When you are done, quit
MAPFIX and run DEFRAG.bas on the RD file. (there is not much to join in
the others, due to minimal intersections).  This may remove some
additional points by further joining lines.  DEFRAG does not do LABELS,
so if you run DEFRAG on a map with labels, they will be lost.

9.  Now you have the smallest APRS maps that can be done automatically.
Reload MAPFIX, reload the RD file and Move the MAP POINTER to the beginning
FEATURE using the RESET command and use the gray +/- keys to cycle through
EVERY point in the file.  Use the alt-D key to delete all unnecessary points.
Look for complete duplicates of some lines too.  Often, both lanes of a 
4-lane or interstate are in the file and will be EXACTLY the same!  These 
steps should get you down to below 3000.

10.  Now simply use the Alt-IMPORT command to bring in each of the other
feature maps.  SImilarly go through and remove unnecessary points.  Be sure
the WHITE box is way out beyond the area of the maps, so there is no
TRUNCATION going on with the IMPORT command (It only imports points within
the white box.).  There are usually LOTS of points that you can remove
from the PB, AB, WB and ST files, with little loss of detail.


NOTE:  If you use the new MAKEMAP.bas/exe program, you will arrive at this
step 10 in ONE step, and only need to do step 6 to begin reducing points.


ALTERNATE PROCESS FOR WB, ST, BP, AB FILES:

    Another way to add some detail from the other non-road USGS files, is to
use the MAPFIX USGS OVERLAY feature to temporarily overlay the USGS data on
the MAPFIX screen without adding points.  Then you use the NEW-FEATURE and
ADD commands to draw APRS features over the top of these temporary points.
The philosopy here is that 96% of amateur interest is on roads, and you
can sure burn up points on waterways and county lines.  For rivers, about
the only points that are important are where the water goes under a bridge.

    You might want to first overlay on the 64 mile scale to see where things
are, but then zoom into the 16 mile scale at least and do the overlay again
to get enough resolution for drawing a particular feature.  Usually, I
sketch in rivers at the 32 mile range, because I do NOT try to get every
kink in a river or stream...  You can use the NEW, ADD and MOVE commands,
but any other commands will redraw the map and wipe-out the overlay.  Just
hit the U command again to reproduce the same overlay.  DO NOT CONFUSE THIS
with alt-U which will WIPE-OUT your map.  Use the Ctrl-R command to toggle
the map REDRAW process on and off. This may help you to add lines without
destroying the USGS overlay.  You can do the overlay again and again.

WARNING!:  NEVER do a second ALT-U USGS BUILD without FIRST saving what
you have, because it will clear memory and start an all new file.


CAUTION:  Do not expect too much from this 2,000,000 CD ROM.  ALthough the 
2,000,000:1 USGS database seems to have resolution down to 1/3 rd of a mile, 
remember that that 1/3rd of a mile was actually 1/100th of an inch on the 
original map!  Your 64 mile section was only a two inch square!!!!!  AND 
THE DATA WAS PROBABLY DERIVED BY A HIGH SCHOOL SUMMER STUDENT using a mouse!


IT STILL TAKES AN EXCESSIVE AMOUNT OF MANUAL EFFORT TO REDUCE THESE MBYTES
OF USGS DATA DOWN TO A reasonably quick loading 25K APRS MAP!  IT TAKES ME 4
to 12 HOURS PER 64 mile MAP!  About 3 hours for 32 mile maps..  By now
(Fall 94) I have done most of the US to the state highway level of detail.
IF YOU WANT ME TO DO A SPECIAL MAP OF YOUR AREA, to the resolution in the
2,000,000:1 ROM, SEND $$$ or convince me it is in the general best interest
of all HAMS.  

FOR THE 100,000:1, I will only do these maps commercially, because the 3 days
worth of effort only results in a map that covers a few miles.  Only a few
HAMS will even live inside one of these small areas.  If you are a MAP-ology
expert, or an ace programmer and can help us figure out a way to better
automate the process, then we would love to make the whole process easier
for everyone.  Contact Ken Swaggart, W7KKE in Calif, or myself.

*****************************************************************************
README.100   (as of 2/13/94)         (  THE OLD WAY BEFORE MKMAPHK1.EXE )

                     100K CD ROM Map Making

                            W7KKE
                         Ken Swaggart
               w7kke @ ka6eyh.#nocal.ca.usa

The 1:100,000 line segment maps contained on the USGS CD ROM uses
a different format than the 1:2,000,000 CD ROM maps. My first
utility, CONV100.BAS, converts the 1:100,000 map "Optional Format"
extracted files to the .GRF file format which can be read by the APRS
MAPFIX.BAS program. When you import these map files into MAPFIX you
will notice they are extremely fragmented into small line segments
which are not adjacent. The second utility, DEFRAG.BAS takes the saved
MAPFIX file and defragments it.

Here are the step by step instructions:

  1. Create a directory on your hard drive where you will be work
on your maps. Stick my programs in this directory and copy
MAPFIX.BAS from the APRS directory into this working map directory.
I use C:\APRSMAPS as my working map directory.

  2. Extract "Transportation" and "Hydrography"  for your area of
interest from the 1:100,000 CD ROM using the extraction program
which comes on the CD ROM. I zoom down to the 15' scale on the USGS
extraction program before I extract the map file. Copy these files
into your working map directory.

  3. Run CONV100c.BAS.  The program will extract each feature, such
as Interstates, US Highways, etc., as separate files with the
filename extension of .GRF.

  4. Run MAPFIX.BAS. Import the first converted .GRF file  by using
the @U command in MAPFIX.BAS. After the file is imported you and on
your MAPFIX screen use the Join command (@J) to join adjacent line
segments for this feature. Save this feature as its own .MAP file
and repeat the process for each map feature you created.

  NOTE: Make sure you use the same origin and scale each time you
        import the .GRF file using the @U command.

  5. Run DEFRAG.BAS to de-fragment the .MAP files you have created.

     If DEFRAG.BAS crashes, you can recover most of your defragmented
     segments. Look for SCRATCH1.TMP and SCRATCH2.TMP. Rename the
     larger of these two and delete the remaining .TMP file.

  6. Use a text editor, such as DOS's EDIT, and examine your
defragmented .MAP files and tweak as you see fit. You may find that
some line segments consist of only one point - EDIT THOSE OUT

  7. Run MAPFIX.BAS again and import your defragmented .MAP file.
Check it over for any obvious errors, correct those, then run the
scruncher function (alt-SCRUNCH) to pare down the .MAP file.

  Note: I generally do not run SCRUNCH on the water boundaries and
streams, but hand edit to reduce the points. Another option which
works well is to use the U command to overlay the water boundaries
and streams, then manually draw in the rivers with the @new and @A
commands. This results if far fewer points than the automatic
method.

 8. Save your scrunched .MAP file and import your next feature and
repeat the process. (I only run the scruncher on each separate
feature file so I can control what gets scrunched.) Sometimes I have
to bump the scruncher factor way up to pare down the points to fit
the total point limit for APRS.

  9. Use a text editor, such as DOS's EDIT, to assemble the final
map from all the defragmented and scrunched .MAP files created for
each map feature type.  BOB COMMENTS:  I prefer to just use the
MAPFIX @IMPORT command to bring these into the working map...

  10. Run MAPFIX again and load the resulting complete .MAP file
with all your features. If it is too large, which it probably is,
delete points until you have a map which will fit within APRS
limits.

  - There is some small errors (less than 1/4 mile) toward the north east
and north west sections of the map. This is due to the conversion scheme
I use to get from the UTM grid to lat/long. The two grids do not line up
exactly. When you join two adjacent 15' maps, you will see that the roads
are off by about 100 meters. Use mapfix to tweak the lines so they join.

PS - watch out for "Streams" - when I extract the ones around here
the resulting .MAP has thousands of points!



