Keyboard Shortcuts
ctrl + shift + ? :
Show all keyboard shortcuts
ctrl + g :
Navigate to a group
ctrl + shift + f :
Find
ctrl + / :
Quick actions
esc to dismiss
Likes
Search
java heap error message on rasp pi 3 when trying to download maps
Are you trying to download maps, or import them from a .pbf file? What is the exact text of the error message? Copy-and-paste, please.
A Raspberry Pi is short on main memory by about an order of magnitude to be able to import a raw OpenStreetMap vector file. Adding swap space won't help; you'll just burn up your swap drive and melt the CPU. The importer logic needs at least 2 gigabytes of real heap memory to be able to handle an OpenStreetMap .pbf file of any significant size. You need to get the pre-imported files I make available on my website with the File->OpenStreetMap->Download Pre-Imported Tiles menu choice. If you were downloading pre-imported tile files, how many of them were you importing? i.e., how many miles/kilometers of radius were you using? If you have a very fast Internet connection, it is theoretically possible for you to overload the Java virtual machine by opening the next tile file faster than the Java garbage collector can clean up after downloading the previous file. Let me know what further information you have on the problem. Andrew, KA2DDO author of YAAC ________________________________________ From: [email protected] <[email protected]> on behalf of Chris Pitre <ve3ctp@...> Sent: Tuesday, July 28, 2020 8:17 PM To: [email protected] Subject: [yaac-users] java heap error message on rasp pi 3 when trying to download maps java heap error message on rasp pi 3 when trying to download maps anyone else encounter this, what did they do to fix the issue? |
Hmmm... indeed, you haven't made much progress on the download.
Can you replicate this and then after it hangs for more than 10 minutes (or if it times out by them), send me the YAAC.out file from your YAAC log directory? The reason I say to wait 10 minutes is for standard TCP/IP timeout to occur, in case that is the cause, so either way I get an accurate error message. The other question is: what exact date and time did you do this? I was upgrading my server around when you sent the original email. So were you in the middle of a download when I shut the server down for upgrade? I always check before I reboot the system, but it doesn't mean you didn't slip in between my check and when the shutdown script turns off networking. Andrew, KA2DDO author of YAAC |
¿ªÔÆÌåÓýTha is what I did, except in my case I did it on a Mac. ?It worked without any fuss.Clark Martin KK6ISP
|
No, that's the one that's probably going to melt your Pi, assuming you have enough non-SD-card storage to handle the import (an SD card can't handle the number of write cycles involved in an import), and are willing to wait a few days.
You should use File->OpenStreetMap->Download Pre-Imported Tiles, which allows you to bypass the painful and resource-intensive process of importing the PBF file into YAAC-format map data. For performing the full-planet import, I use an 8-core 3.0 GHz gaming server with 36GB of RAM and a solid-state disk just for the DB index files (which has been replaced twice over the development lifetime of YAAC due to wearing it out from imports), and it still takes over 20 hours. Andrew, KA2DDO author of YAAC ________________________________________ From: [email protected] <[email protected]> on behalf of Dave Garber <ve3wej@...> Sent: Tuesday, August 4, 2020 3:52 PM To: [email protected] Subject: Re: [yaac-users] java heap error message on rasp pi 3 when trying to download maps ok, YAAC installed, downloading geofabrik north america pbf file. should be done in about an hour or more hope that the right one Dave Garber VE3WEJ / VE3IE |
Dave Garber
ok, if i select pre tiles, a window pops up, with info on it.? ? what is the next step from this Dave Garber VE3WEJ / VE3IE On Tue, Aug 4, 2020 at 4:00 PM Andrew P. <andrewemt@...> wrote: No, that's the one that's probably going to melt your Pi, assuming you have enough non-SD-card storage to handle the import (an SD card can't handle the number of write cycles involved in an import), and are willing to wait a few days. |
Dave Garber
ok, I have 4 subfolders in the tiles subdirectory, but still no map Dave Garber VE3WEJ / VE3IE On Tue, Aug 4, 2020 at 4:10 PM Dave Garber via <ve3wej=[email protected]> wrote:
|
Pan or zoom the map a bit. It doesn't reliably recalculate the map when download is complete.
Also, did you download in the correct area? There have been bug reports when people downloaded using East longitude instead of West longitude, so they had no map data for Missouri but lots of data for Afghanistan (for example) cluttering up their disk drive. If you go to File->OpenStreetMap->Download Pre-Imported Tiles again, the black rectangle should now have a clump of blue and/or white dots on it indicating 1x1-degree tiles for which you have downloaded map data. The upper-left quadrant of the rectangle covers North America and the Caribbean, the lower-left quadrant is South America, and the right half is the corresponding Eastern hemisphere of the globe. So, is that clump of dots in the correct place relative to where your station location would appear on a world map? Note that those 4 directories you pointed out should be named with the latitudes of the 1-degree chunks you downloaded. Since you have an Ontario Canada callsign prefix, I'm assuming you should have N43 and N44 directories (assuming you're around Toronto, although you might have N48 and N49 if you were in Thunder Bay). Andrew, KA2DDO author of YAAC ________________________________________ From: [email protected] <[email protected]> on behalf of Dave Garber <ve3wej@...> Sent: Tuesday, August 4, 2020 5:08 PM To: [email protected] Subject: Re: [yaac-users] java heap error message on rasp pi 3 when trying to download maps ok, I have 4 subfolders in the tiles subdirectory, but still no map Dave Garber VE3WEJ / VE3IE On Tue, Aug 4, 2020 at 4:10 PM Dave Garber via groups.io<> <ve3wej@...<mailto:[email protected]>> wrote: ok, if i select pre tiles, a window pops up, with info on it. what is the next step from this Dave Garber VE3WEJ / VE3IE On Tue, Aug 4, 2020 at 4:00 PM Andrew P. <andrewemt@...<mailto:andrewemt@...>> wrote: No, that's the one that's probably going to melt your Pi, assuming you have enough non-SD-card storage to handle the import (an SD card can't handle the number of write cycles involved in an import), and are willing to wait a few days. You should use File->OpenStreetMap->Download Pre-Imported Tiles, which allows you to bypass the painful and resource-intensive process of importing the PBF file into YAAC-format map data. For performing the full-planet import, I use an 8-core 3.0 GHz gaming server with 36GB of RAM and a solid-state disk just for the DB index files (which has been replaced twice over the development lifetime of YAAC due to wearing it out from imports), and it still takes over 20 hours. Andrew, KA2DDO author of YAAC ________________________________________ From: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>> on behalf of Dave Garber <ve3wej@...<mailto:ve3wej@...>> Sent: Tuesday, August 4, 2020 3:52 PM To: [email protected]<mailto:[email protected]> Subject: Re: [yaac-users] java heap error message on rasp pi 3 when trying to download maps ok, YAAC installed, downloading geofabrik north america pbf file. should be done in about an hour or more hope that the right one Dave Garber VE3WEJ / VE3IE |
The next step is to select the area you wish to download by center position and radius (for example, 200 kilometers around your lat/lon), and click OK. Before you click OK, you can optionally use the filters to get rid of map data types you may not care about (such as Nodes for individual trees, or administrative/political boundary Ways) and don't want to waste disk storage and CPU time on rendering.
Andrew, KA2DDO author of YAAC ________________________________________ From: [email protected] <[email protected]> on behalf of Dave Garber <ve3wej@...> Sent: Tuesday, August 4, 2020 4:10 PM To: [email protected] Subject: Re: [yaac-users] java heap error message on rasp pi 3 when trying to download maps ok, if i select pre tiles, a window pops up, with info on it. what is the next step from this Dave Garber VE3WEJ / VE3IE On Tue, Aug 4, 2020 at 4:00 PM Andrew P. <andrewemt@...<mailto:andrewemt@...>> wrote: No, that's the one that's probably going to melt your Pi, assuming you have enough non-SD-card storage to handle the import (an SD card can't handle the number of write cycles involved in an import), and are willing to wait a few days. You should use File->OpenStreetMap->Download Pre-Imported Tiles, which allows you to bypass the painful and resource-intensive process of importing the PBF file into YAAC-format map data. For performing the full-planet import, I use an 8-core 3.0 GHz gaming server with 36GB of RAM and a solid-state disk just for the DB index files (which has been replaced twice over the development lifetime of YAAC due to wearing it out from imports), and it still takes over 20 hours. Andrew, KA2DDO author of YAAC ________________________________________ From: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>> on behalf of Dave Garber <ve3wej@...<mailto:ve3wej@...>> Sent: Tuesday, August 4, 2020 3:52 PM To: [email protected]<mailto:[email protected]> Subject: Re: [yaac-users] java heap error message on rasp pi 3 when trying to download maps ok, YAAC installed, downloading geofabrik north america pbf file. should be done in about an hour or more hope that the right one Dave Garber VE3WEJ / VE3IE |
Dave Garber
I sent a snip of my set screen, and although not wide ( and it wont go wider) I see 83.... west? and 42....north the four folders are labelled n37 n38 n40 and n41.? yes there are files inside those folders.. i am not worrying yet about unchecking all the trees (lol)? ?and Buoys yet.? ?I would like to see a map first and have the local aprs hams show up in the correct position on my screen.. oh, and yes I have activity on my screen, just no map to follow where they are. Dave Garber VE3WEJ / VE3IE On Tue, Aug 4, 2020 at 5:35 PM Andrew P. <andrewemt@...> wrote: Pan or zoom the map a bit. It doesn't reliably recalculate the map when download is complete. |
Odd that you don't have a n39 subdirectory (or did you just skip mentioning it?). What are the numbers on the files in those subdirectories? They should look like W83.ways, W83.nodes, and so forth (given the latitude and longitude you told me).
________________________________________ From: [email protected] <[email protected]> on behalf of Dave Garber <ve3wej@...> Sent: Tuesday, August 4, 2020 6:29 PM To: [email protected] Subject: Re: [yaac-users] java heap error message on rasp pi 3 when trying to download maps I sent a snip of my set screen, and although not wide ( and it wont go wider) I see 83.... west and 42....north the four folders are labelled n37 n38 n40 and n41. yes there are files inside those folders.. i am not worrying yet about unchecking all the trees (lol) and Buoys yet. I would like to see a map first and have the local aprs hams show up in the correct position on my screen.. oh, and yes I have activity on my screen, just no map to follow where they are. Dave Garber VE3WEJ / VE3IE On Tue, Aug 4, 2020 at 5:35 PM Andrew P. <andrewemt@...<mailto:andrewemt@...>> wrote: Pan or zoom the map a bit. It doesn't reliably recalculate the map when download is complete. Also, did you download in the correct area? There have been bug reports when people downloaded using East longitude instead of West longitude, so they had no map data for Missouri but lots of data for Afghanistan (for example) cluttering up their disk drive. If you go to File->OpenStreetMap->Download Pre-Imported Tiles again, the black rectangle should now have a clump of blue and/or white dots on it indicating 1x1-degree tiles for which you have downloaded map data. The upper-left quadrant of the rectangle covers North America and the Caribbean, the lower-left quadrant is South America, and the right half is the corresponding Eastern hemisphere of the globe. So, is that clump of dots in the correct place relative to where your station location would appear on a world map? Note that those 4 directories you pointed out should be named with the latitudes of the 1-degree chunks you downloaded. Since you have an Ontario Canada callsign prefix, I'm assuming you should have N43 and N44 directories (assuming you're around Toronto, although you might have N48 and N49 if you were in Thunder Bay). Andrew, KA2DDO author of YAAC ________________________________________ From: [email protected]<mailto:[email protected]> <[email protected]<mailto:[email protected]>> on behalf of Dave Garber <ve3wej@...<mailto:ve3wej@...>> Sent: Tuesday, August 4, 2020 5:08 PM To: [email protected]<mailto:[email protected]> Subject: Re: [yaac-users] java heap error message on rasp pi 3 when trying to download maps ok, I have 4 subfolders in the tiles subdirectory, but still no map Dave Garber VE3WEJ / VE3IE On Tue, Aug 4, 2020 at 4:10 PM Dave Garber via groups.io<><> <ve3wej@...<mailto:[email protected]><mailto:[email protected]<mailto:[email protected]>>> wrote: ok, if i select pre tiles, a window pops up, with info on it. what is the next step from this Dave Garber VE3WEJ / VE3IE On Tue, Aug 4, 2020 at 4:00 PM Andrew P. <andrewemt@...<mailto:andrewemt@...><mailto:andrewemt@...<mailto:andrewemt@...>>> wrote: No, that's the one that's probably going to melt your Pi, assuming you have enough non-SD-card storage to handle the import (an SD card can't handle the number of write cycles involved in an import), and are willing to wait a few days. You should use File->OpenStreetMap->Download Pre-Imported Tiles, which allows you to bypass the painful and resource-intensive process of importing the PBF file into YAAC-format map data. For performing the full-planet import, I use an 8-core 3.0 GHz gaming server with 36GB of RAM and a solid-state disk just for the DB index files (which has been replaced twice over the development lifetime of YAAC due to wearing it out from imports), and it still takes over 20 hours. Andrew, KA2DDO author of YAAC ________________________________________ From: [email protected]<mailto:[email protected]><mailto:[email protected]<mailto:[email protected]>> <[email protected]<mailto:[email protected]><mailto:[email protected]<mailto:[email protected]>>> on behalf of Dave Garber <ve3wej@...<mailto:ve3wej@...><mailto:ve3wej@...<mailto:ve3wej@...>>> Sent: Tuesday, August 4, 2020 3:52 PM To: [email protected]<mailto:[email protected]><mailto:[email protected]<mailto:[email protected]>> Subject: Re: [yaac-users] java heap error message on rasp pi 3 when trying to download maps ok, YAAC installed, downloading geofabrik north america pbf file. should be done in about an hour or more hope that the right one Dave Garber VE3WEJ / VE3IE |
Dave Garber
this is the latest Dave Garber VE3WEJ / VE3IE On Tue, Aug 4, 2020 at 6:35 PM Andrew P. <andrewemt@...> wrote: Odd that you don't have a n39 subdirectory (or did you just skip mentioning it?). What are the numbers on the files in those subdirectories? They should look like W83.ways, W83.nodes, and so forth (given the latitude and longitude you told me). |
Dave Garber
Do I put zip files and there subfolders in yaac. Or do I extract.? ?To where? sent by my LG phone On Sun, Aug 9, 2020, 9:20 PM , <k1hu@...> wrote: one more try to post. |
Unless you explicitly need map data I haven't made available on my website yet (I'm about a month behind right now) and have a machine large enough to handle the extremely expensive process of converting the OpenStreetMap database export PBF or BZ2 file into YAAC binary map data, I strongly recommend that you just let each computer running YAAC download the pre-imported binary files on my website. This avoids version compatibility issues and probable heap exhaustion failures on undersized machines; I have to use a large gaming system with 36GB of RAM and a solid state disk just for the temporary index files to import the planet-sized OpenStreetMap export file, and that still takes over a day on such oversized hardware.
It is almost guaranteed that a Raspberry Pi cannot get enough heap memory to do an OpenStreetMap import, and it will certainly burn out your SD card unless you have some other kind of disk storage connected to the Pi to support the import operation. Importing is very easy. On the YAAC menu, select File->OpenStreetMap->Download Pre-Imported Tiles, then when the dialog box comes up, select the area you want to download (re-downloads just overwrite your existing map data with newer data), and click OK to start the transfer. Andrew, KA2DDO author of YAAC ________________________________________ From: [email protected] <[email protected]> on behalf of Dave Garber <ve3wej@...> Sent: Sunday, August 9, 2020 9:37 PM To: [email protected] Subject: Re: [yaac-users] java heap error message on rasp pi 3 when trying to download maps Do I put zip files and there subfolders in yaac. Or do I extract. To where? sent by my LG phone On Sun, Aug 9, 2020, 9:20 PM , <k1hu@...<mailto:k1hu@...>> wrote: one more try to post. If you can; install YAAC on a PC(either windows or linux); you can then use the PC version to download the maps. And save them for use on other YAAC installations. Then use a file transfer program to put the map files onto the Pi. |
to navigate to use esc to dismiss