Welcome, Guest. Please login or register.
Did you miss your activation email?

News: Precision Simulator update 10.85 (23 July 2019) is now available

Author Topic: METAR Download Issues  (Read 1194 times)

RRVyper

  • Join date: Sep 2018
  • Posts: 53
METAR Download Issues
« on: Fri, 12 Apr 2019 16:29 »
Hi!
I was wondering if anyone else is having issues getting the weather to download. The last couple of days the METAR would begin to download but hang at a certain point (26% yesterday, 9% today). Yesterday I restarted PSX (10.76) and it still would finish getting the weather. Even, un-ticking the download box and re-ticking it did not help. I ended up shutting down PSX, deleting the METAR files and restarting PSX. It worked fine after that. I closed PSX at some point and resumed the flight today. Now I am having further issues. I updated the Sim time to current time but noticed METAR download stalled at 9%. After about 1/2 hr the Instructor/Weather page shows Disk: 1.9m/1.3m 11 Apr 2019, 2312z (next STBY). The site (https://tgftp.nws.noaa.gov/data/observations/metar/cycles/) shows good data for the nearest stations for 12 Apr (it is currently 1529z) but the latest METAR file in the Weather folder (2019041213.metar) is only 146KB in size. It seems like PSX can't get the complete file even though I can download it myself in the browser.
I am running FSX on the same laptop as a scenery generator via VisualPSX so Server and Boost are active. Could this be interfering?

Any ideas/suggestions?

Randy

asboyd

  • Join date: Jan 2012
  • Location: YSSY
  • Posts: 393
Re: METAR Download Issues
« Reply #1 on: Fri, 12 Apr 2019 23:21 »
I am running PSX on one machine with boost and main server on and it takes a few minutes to get the full download but it does happen...
So a little slow but OK...

Regards,
Alex B

RRVyper

  • Join date: Sep 2018
  • Posts: 53
Re: METAR Download Issues
« Reply #2 on: Sat, 13 Apr 2019 16:11 »
Thanks, Alex. I just fired up PSX by itself and it downloaded fine. Strange. I'll keep an eye on it in the future. I was also having an issue keeping FSX connected to VisualPSX yesterday after I posted (all running on the same laptop). Maybe the issues were related or I was overtaxing the machine.

Randy

asboyd

  • Join date: Jan 2012
  • Location: YSSY
  • Posts: 393
Re: METAR Download Issues
« Reply #3 on: Sun, 14 Apr 2019 00:07 »
Are you using windows 10 if so they pushed out some heavy security updates this week and that slowed my machine (and of course internet) down... I normally get 50Mb/s on the net connection but during this I found my CPU and disk were getting hammered so everything (including Outlook) were very slow to the point of seeming like the PC locked up.

Regards,
Alex B

RRVyper

  • Join date: Sep 2018
  • Posts: 53
Re: METAR Download Issues
« Reply #4 on: Sun, 14 Apr 2019 18:51 »
Interesting. Yes, I am using Windows 10. I didn't notice any other activity. I'm getting issues today as well. Download is stuck at 15%. I'm just sitting at the gate (CYWG) with power off. I'm on Wi-Fi with a strong signal and see no issues when surfing the Net. Again, Main and Boost servers are running (with VisualPSX and FSX-SE). Last METAR file in the Weather folder is 2019041416.metar but even after 15 minutes, it only shows 331kB as the file size. So it appears there is still an issue here. Task Manager Wi-Fi shows minimal activity and CPU and Graphics are below 50%. 😒

Holger Wende

  • Join date: May 2009
  • Location: EDDM
  • Posts: 309
Re: METAR Download Issues
« Reply #5 on: Sun, 14 Apr 2019 20:31 »
Hi

Just in case you have old weather URLs in your preferences files.
Check the thread under http://aerowinx.com/board/index.php?topic=4116.

Regards, Holger

asboyd

  • Join date: Jan 2012
  • Location: YSSY
  • Posts: 393
Re: METAR Download Issues
« Reply #6 on: Sun, 14 Apr 2019 21:59 »
Randy,
I am using the "new" url and I just tested again from YSSY (Sydney Aus) it took almost 1 minute on an 80Mb/s cable connection to download the full file, so maybe the Metar server has slow response times and may appear "hung".

Regards,
Alex B

RRVyper

  • Join date: Sep 2018
  • Posts: 53
Re: METAR Download Issues
« Reply #7 on: Mon, 15 Apr 2019 00:11 »
Hi

Just in case you have old weather URLs in your preferences files.
Check the thread under http://aerowinx.com/board/index.php?topic=4116.

Regards, Holger
Thanks, Holger. I mentioned the URL in my first post. 👍

I had to shut down PSX, delete the files in the Weather folder and restart PSX. It downloaded fine after that, but that's the second time I've had to do that. I'm on 300 Mbps cable so it should come down pretty fast. 😉

Randy

Hardy Heinlin

  • Moderator
  • Join date: May 2009
  • Posts: 10667
    • Aerowinx
Re: METAR Download Issues
« Reply #8 on: Mon, 15 Apr 2019 03:56 »
The files in the Aerowinx/Weather folder have no influence on your download speed.

You wrote you had no issues when running PSX solo. So the problem seems to lie in your network system.

I don't recommend to use Wi-Fi to connect PSX network components. Your signal may be strong, but it may break nevertheless.


Regards,

|-|ardy

RRVyper

  • Join date: Sep 2018
  • Posts: 53
Re: METAR Download Issues
« Reply #9 on: Mon, 15 Apr 2019 16:54 »
The files in the Aerowinx/Weather folder have no influence on your download speed.
Agreed, Hardy. It's not the download speed that is the issue. It's that PSX sometimes hangs while downloading and sometimes won't recover. I reset the cable modem/router and will see how things go today. Also, I am not running this instance of PSX in a network config between computers; the network is only for running FSX as an external scenery generator, all on the same laptop.

Randy

P.S. Initial test today (running PSX solo) look promising - the 1st download completed in about 5 mins and the next one 2 minutes afterwards. It seems slow for a 2 MB file, but perhaps WX downloading is running at a lower priority than the rest of the PSX simulation. I will test with VisualPSX once I am satisfied PSX is OK by itself.

Hardy Heinlin

  • Moderator
  • Join date: May 2009
  • Posts: 10667
    • Aerowinx
Re: METAR Download Issues
« Reply #10 on: Mon, 15 Apr 2019 17:58 »
Indeed, the download thread within the sim's multitasking system has a lower priority than the threads of the aircraft systems. This is intentional. The aircraft systems always have the highest priority to make the sim as smooth and fast as possible. The performance difference, however, is computer dependent. On my Mac I never see a difference higher than 5%, if at all. Maybe you have less multicore resources when you run FSX on the same CPU.


|-|ardy

RRVyper

  • Join date: Sep 2018
  • Posts: 53
Re: METAR Download Issues
« Reply #11 on: Mon, 15 Apr 2019 19:44 »
I allowed a few weather updates to happen on a flight from CYWG to CYVR then started FSX and VisualPSX, activated Main and Boost servers and launched FSWX, a weather program for FSX/P3D. There seems to be some 'interference' when FSWX is running as I will get occasional loss of connection between VisualPSX and FSX. And I noticed the weather files would also stop downloading in PSX (stuck at a Downloading... xx%). I shut down FSWX and had no more issues with the comms between PSX and FSX, but the weather never reinitialized - remained at xx% even after landing. Also tried toggling 'Set zones by flight track and downloaded METARs' on Weather tab and 'Allow METAR files download from Internet' in Preferences/Basics - no joy. It appears once the download hangs, it doesn't reset itself. Download speed on WiFi is 50 Mbps so the bandwidth is there. I'll check resource utilization next but will have to restart PSX as it is still stuck. I suspect I may be pushing this laptop a bit too much (Win 10/i7-8550U 1.8 GHz/Intel UHD 620 Graphics/12 GB DDR4/256 GB SSD).

Here is the error.txt log. It does seem to point to some network issue, I think.

[Aerowinx Precision Simulator - Exceptions]

java.net.SocketException: Socket closed
   at java.net.SocketInputStream.socketRead0(Native Method)
   at java.net.SocketInputStream.socketRead(Unknown Source)
   at java.net.SocketInputStream.read(Unknown Source)
   at java.net.SocketInputStream.read(Unknown Source)
   at sun.nio.cs.StreamDecoder.readBytes(Unknown Source)
   at sun.nio.cs.StreamDecoder.implRead(Unknown Source)
   at sun.nio.cs.StreamDecoder.read(Unknown Source)
   at java.io.InputStreamReader.read(Unknown Source)
   at java.io.BufferedReader.fill(Unknown Source)
   at java.io.BufferedReader.readLine(Unknown Source)
   at java.io.BufferedReader.readLine(Unknown Source)
   at NetServerThread.run(NetServerThread.java:210)

Randy

Jeroen Hoppenbrouwers

  • Moderator
  • Join date: May 2009
  • Location: KTMB
  • Posts: 3519
  • Hoppie designs avionics equipment for airliners.
    • http://www.hoppie.nl/
Re: METAR Download Issues
« Reply #12 on: Tue, 16 Apr 2019 01:18 »
I'm going off on a wild guess here. The download speed, or progress, also depends on the weather server. If for whatever reason that server decides you're too hungry it may temporarily block you, to give others a fair shot at the resources. If, say, FSX weather agressively downloads stuff, it may cause the server to temporarly block your IP and then PSX suffers.

It may be interesting to use a web browser to simulate weather download using the same URL as PSX and see what that does.

Hoppie

asboyd

  • Join date: Jan 2012
  • Location: YSSY
  • Posts: 393
Re: METAR Download Issues
« Reply #13 on: Tue, 16 Apr 2019 01:24 »
Accoring to PSX (my METAR settings are default for "live" weather) the download takes place every 23 minutes, FSX by default is every 10, so you may be onto something Hoppie... I use AS for P3D and I have it set for every 25 minutes so almost the same as PSX.... and have no problems, but my scenery is on a separate machine but they all use a single gateway so appear as though they come from one public IP....

Cheers,

RRVyper

  • Join date: Sep 2018
  • Posts: 53
Re: METAR Download Issues
« Reply #14 on: Tue, 16 Apr 2019 01:28 »
So, I began another round of testing this evening. Running PSX solo seems to work fine. I let it run for a few weather downloads and all was good. I was using the Basic 004 - Cleared for takeoff.situ for testing. Here are the steps and results:

Weather Folder Emptied
PSX Start Time 2034Z
WX download completed (2 files - 2019041519.metar, 2019041520.metar) at 2036Z (2.2m/1.8m Next 2115Z).
   Climbing through FL250: java.exe - Average CPU 27%
WX download completed (1 file - 2019041521.metar) at 2118Z (1.8m/1.4m Next 2143Z).
   java.exe - Average CPU 24%
   Total CPU around 50%
WX download completed (1 file - 2019041521.metar) at 2142Z (1.8m/2.2m Next 2210Z).
   java.exe - Average CPU 27%
Close PSX

Delete files in Weather folder
Restart PSX at 152149Z Apr (same .situ)
WX download completed (2 files - 2019041520.metar, 2019041521.metar) at 2036Z (2.2m/2.3m Next 2208Z).
Load FSX (B747-400 at TNCC Rwy 11)
Start VisualPSX at 2159Z
Start Main and Boost Servers
WX download completed (1 file - 2019041522.metar) at 2207Z (2.3m/1.1m Next 2243Z).
Climbing through FL250
   java.exe - Average CPU 38%
   FSX.exe - Average CPU 27%
   VisualPSX.exe - Average CPU 0.3%
   Total CPU around 82%
   Avg Network I/O 206 kbps
WX download initiated at 2243Z but not completed (paused at 86%, then stopped at 92%). No further downloads. Checked METAR site and updated files were there for 23Z and 00Z. Errors.txt was empty.

These files come down in about 2 seconds in a web browser so I'm not sure what the issue could be. Perhaps running the server is interfering. There's quite alot of data transferring from PSX to FSX (steady 200 kbps).

Something's not right.

Randy

RRVyper

  • Join date: Sep 2018
  • Posts: 53
Re: METAR Download Issues
« Reply #15 on: Tue, 16 Apr 2019 01:32 »
I'm going off on a wild guess here. The download speed, or progress, also depends on the weather server. If for whatever reason that server decides you're too hungry it may temporarily block you, to give others a fair shot at the resources. If, say, FSX weather agressively downloads stuff, it may cause the server to temporarly block your IP and then PSX suffers.

It may be interesting to use a web browser to simulate weather download using the same URL as PSX and see what that does.

Hoppie
Hi Hoppie.
For the last test I disabled FSX weather downloading (default used a different server which no longer works, hence the FSWX program). At any time during the PSX/FSX flight I am able to access the URL and download the weather files without issue.

Randy

Hardy Heinlin

  • Moderator
  • Join date: May 2009
  • Posts: 10667
    • Aerowinx
Re: METAR Download Issues
« Reply #16 on: Tue, 16 Apr 2019 01:44 »
Quote
There's quite alot of data transferring from PSX to FSX (steady 200 kbps)

200 kB per sec? That's not normal. Way too much. What's your frame rate in PSX?


|-|ardy

RRVyper

  • Join date: Sep 2018
  • Posts: 53
Re: METAR Download Issues
« Reply #17 on: Tue, 16 Apr 2019 02:42 »
That's kilobits/sec, Hardy. PSX is showing 75 FPS.

Randy

Hardy Heinlin

  • Moderator
  • Join date: May 2009
  • Posts: 10667
    • Aerowinx
Re: METAR Download Issues
« Reply #18 on: Tue, 16 Apr 2019 04:30 »
Still unusually high, I think.

The boost server sends about 64 bytes per frame.
The main server sends about 420 bytes per second -- plus some occassional peaks above 30 kByte.

64 bytes x 75 = 4800 bytes

So approx. 6000 bytes, i.e. ca. 48000 Bit per second.

Just for a test: Can you go to Instructor > Preferences > Basics, and set the frame rate limit to 48/3, and see if your network monitor still indicates 200 kBits?


|-|ardy

RRVyper

  • Join date: Sep 2018
  • Posts: 53
Re: METAR Download Issues
« Reply #19 on: Tue, 16 Apr 2019 14:10 »
My bad, Hardy. The Avg Network I/O of 206 kilobits/sec was for all network activity. When I said there was a steady 200 kbps between PSX and FSX, that was incorrect. It should have said ~5.8 kilobytes/sec, which is more in line with what you mentioned. Sorry for that. At 48/3 fps, I'm showing ~2.2 kilobytes/sec.

Randy