Help- Scrape interactive information (java) from a (Google) Map

904 Views | 5 Replies | Last: 2 yr ago by sawemoffshort07
sawemoffshort07
How long do you want to ignore this user?
AG
I am trying to get, preferably a shp or kmz, but a series of lat/long could work as well, path from an interactive map. This one pipeline company will not share a shp/kmz; providing very minimal, low resolution maps; however, their website has a java lesser resolution (higher altitude) interactive map (mapbox and openstreetmap) showing the line(s) and also a pipeline locator that has a java higher resolution (lower altitude) that shows the line(s). I am trying to find the source to pull, or otherwise get pipeline location information. Anyone have any insight on this?
Sponge
How long do you want to ignore this user?
AG
The data used to build the line is probably coming over network traffic. Either in it's own request or bundled up with a bunch of other data. But it will be a big array of lat/lon so it should be easy to spot.
sawemoffshort07
How long do you want to ignore this user?
AG
Could I get in touch with you separately to give more details and exchange ideas?
sawemoffshort07
How long do you want to ignore this user?
AG
Following up, Sponge, or anyone else? I can give details separately on what I am trying to do.
Mr President Elect
How long do you want to ignore this user?
AG
In chrome click the three dots in the top right and then click "more tools"->"Developer Tools" (also, f12 or ctrl+shift+i are usually shortcuts).

Once open, navigate to the "Network" tab. Under this, look for the "Fetch/XHR" section. Refresh your page to see various requests. Click on these requests and examine the "Preview" or "Response" tabs for more details. This is a good starting point.

sawemoffshort07
How long do you want to ignore this user?
AG
Mr President Elect, thank you. I was poking around in "Inspect" and was in network but had not made it to "Fetch" yet. Thank you.
Refresh
Page 1 of 1
 
×
subscribe Verify your student status
See Subscription Benefits
Trial only available to users who have never subscribed or participated in a previous trial.