Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix usace swtwc #149

Merged
merged 10 commits into from
Mar 24, 2019
Merged

Fix usace swtwc #149

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
2221b77
fix for usace swtwc data format change
solomon-negusse Aug 25, 2017
7e0528b
remove debugging print stmt
solomon-negusse Aug 25, 2017
95e1431
fix for usace swtwc data format change
solomon-negusse Aug 25, 2017
b5b5902
remove debugging print stmt
solomon-negusse Aug 25, 2017
4d5e776
Merge branch 'fix-usace-swtwc' of github.com:ulmo-dev/ulmo into fix-u…
solomon-negusse Aug 25, 2017
d2a7820
remove another debugging print stmt
solomon-negusse Aug 25, 2017
82891dc
Merge branch 'master' into fix-usace-swtwc
solomon-negusse Mar 21, 2019
41267c7
string formatting update
solomon-negusse Mar 22, 2019
4589a1a
adding User-Agent header for USACE requests to work
solomon-negusse Mar 22, 2019
a74ecae
stations fix
solomon-negusse Mar 23, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
168 changes: 168 additions & 0 deletions test/files/usace/swtwc/DSNT2.20170725.html
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,168 @@

<HTML>
<HEAD>
<TITLE>MYST2: Pat Mayse Lake (tabular)</TITLE>
<META This file generated by z:\Python\MakeWWWGagePages.py on 2013/02/18 at 15:07:26>
</HEAD>
<BODY>
<H2>MYST2: <EM>Pat Mayse Lake</EM></H2>
<H4>Data processed at Tue Feb 19 15:07:26 2013 Central Standard Time</H4>
<HR>
All information presented herein is the property of the government of the
United States of America and may be revised or deleted at any time without
prior notice.
<BR>

<HTML lang="en-US">
<HEAD>
<TITLE>DSNT2: Lake Texoma, Denison Dam (tabular)</TITLE>
<META This file generated by sys.argv[0] on 2017/07/25 at 22:26:40>
</HEAD>
<BODY>
<H2>DSNT2: <EM>Lake Texoma, Denison Dam</EM></H2>
<H4>Data processed at Thu Jul 27 2017 22:26 </H4>
<HR>
All information presented herein is the property of the government of the
United States of America and may be revised or deleted at any time without
prior notice.
<BR>
Dissemination of this information without the expressed written consent of
the Public Affairs Office, Tulsa District U.S. Army Corps of Engineers is
strictly prohibited.
<BR>
<STRONG>These data are gathered electronically and, as presented, have not
undergone any form of quality control. These data are not guaranteed to be
valid or correct.</STRONG>
<HR>
Go to <A HREF=http:\\www.swt-wc.usace.army.mil/>home page.</A>
<BR>
Go to <A HREF="./stations.php">station list.</A>
<P>
Upstream stations:
<UL>
<LI><A HREF="CWRO2.20170725.html">CWRO2 : Washita Rv at Cumberland Cut, nr Cumberland, OK, Hwy 199</A></LI>
<LI><A HREF="GSVT2.20170725.html">GSVT2 : Red River, Gainesville, TX</A></LI>
</UL>

Downstream station:
<UL>
<LI><A HREF="DSTT2.20170725.html">DSTT2 : Red River at Denison Dam nr Denison, TX</A></LI>
</UL>

<BR>
<A HREF="DSNT2.20170724.html">Previous Day</A>
<BR>
<A HREF="DSNT2.20170726.html">Next Day</A>
<BR>
<A HREF="DSNT2.current.html">Current Day</A>
<HR>
<PRE>

SHEF ID: DSNT2 Lake Texoma, Denison Dam
STATION TYPE: Reservoir
Normal Pool: Bottom = 590.00, Top = 618.38

PRECIP PRECIP(A) ELEVATION STORAGE TW-ELEV INFLOW RELEASE AIR-TEMP WIND-DIRWIND-SPEED REL-HUMID SOLAR-RAD VOLTAGE BAT-LOAD
in in ft ac-ft ft cfs cfs F deg mph % W/m2 volt volt
Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev Regi-Rev Regi-Rev Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev
(US/Central)
07/25 00:00 0.00 0.00 617.74 2573092 501.88 776 19 80.76 173.90 4.13 78.38 0.00 11.78 11.42
07/25 01:00 0.00 0.00 617.73 2572324 501.87 564 19 80.10 135.90 1.42 81.98 0.00 11.77 11.37
07/25 02:00 0.00 0.00 617.74 2573092 501.87 352 19 78.78 77.70 1.09 85.28 0.00 11.78 11.42
07/25 03:00 0.00 0.00 617.74 2573092 501.87 352 19 77.13 112.20 3.82 90.53 0.00 11.78 10.60
07/25 04:00 0.00 0.00 617.74 2573092 501.87 351 19 77.79 114.00 2.04 87.29 0.00 11.77 11.42
07/25 05:00 0.00 0.00 617.74 2573092 501.87 2 19 76.24 87.10 2.25 91.50 0.00 11.77 11.42
07/25 06:00 0.00 0.00 617.73 2572324 501.88 1 19 75.81 103.10 3.10 92.85 0.00 11.78 11.42
07/25 07:00 0.00 0.00 617.73 2572324 501.87 0 19 75.25 105.10 3.42 93.64 17.00 11.78 11.42
07/25 08:00 0.00 0.00 617.73 2572324 501.87 0 19 78.67 127.80 1.66 85.09 171.00 11.80 11.42
07/25 09:00 0.00 0.00 617.73 2572324 501.88 111 19 81.52 198.90 3.80 77.40 389.00 11.81 11.42
07/25 10:00 0.00 0.00 617.74 2573092 501.88 231 19 83.71 213.20 4.65 70.20 611.00 11.81 11.42
07/25 11:00 0.00 0.00 617.71 2570787 503.68 259 19 85.26 225.40 4.55 65.80 782.00 11.81 11.42
07/25 12:00 0.00 0.00 617.73 2572324 509.44 282 9819 88.00 158.40 3.38 62.32 705.00 11.80 11.42
07/25 13:00 0.00 0.00 617.72 2571555 509.79 282 10569 91.08 148.60 2.87 59.33 985.00 11.79 11.42
07/25 14:00 0.00 0.00 617.71 2570787 509.80 171 10319 91.42 149.90 4.06 53.60 1047.00 11.80 11.42
07/25 15:00 0.00 0.00 617.69 2569250 509.79 76 10319 92.07 138.20 5.92 53.66 901.00 11.82 11.42
07/25 16:00 0.00 0.00 617.67 2567713 509.79 73 10319 92.84 146.20 7.06 53.35 662.00 11.80 11.42
07/25 17:00 0.00 0.00 617.65 2566177 509.79 74 10319 92.41 140.00 6.62 50.42 700.00 11.80 11.42
07/25 18:00 0.00 0.00 617.64 2565408 509.80 74 10319 92.73 150.00 9.26 44.62 500.00 11.80 11.42
07/25 19:00 0.00 0.00 617.64 2565408 509.79 74 10569 91.96 137.50 6.66 51.95 285.00 11.79 11.42
07/25 20:00 0.00 0.00 617.62 2563871 509.79 50 10569 89.65 130.40 6.07 58.54 86.00 11.78 11.42
07/25 21:00 0.00 0.00 617.61 2563103 509.81 25 10319 87.03 128.80 6.81 60.92 1.00 11.79 11.42
07/25 22:00 0.00 0.00 617.64 2565408 508.62 0 10319 85.80 131.70 6.84 62.32 0.00 11.79 11.42
07/25 23:00 0.00 0.00 617.61 2563103 502.61 0 1019 84.70 138.90 5.71 62.26 0.00 11.79 11.42

</PRE>
<HR>
</BODY>
</HTML>

Dissemination of this information without the expressed written consent of
the Public Affairs Office, Tulsa District U.S. Army Corps of Engineers is
strictly prohibited.
<BR>
<STRONG>These data are gathered electronically and, as presented, have not
undergone any form of quality control. These data are not guaranteed to be
valid or correct.</STRONG>
<HR>
Go to <A HREF="HTTP:/">home page.</A>
<BR>
Go to <A HREF="HTTP:/stations.htm">station list.</A>
<BR>
Go to <A HREF="HTTP:/#BASINMAP">station map.</A>
<P>

Downstream station:
<UL>
<LI><A HREF="ARCT2.20130218.html">ARCT2: <EM>Red River, ARthur City</EM></A></LI>
</UL>

<A HREF="MYST2.20130217.html">Previous Day</A>
<BR>
<A HREF="MYST2.20130219.html">Next Day</A>
<BR>
<A HREF="MYST2.current.html">Current Day</A>
<P>
<A HREF="MYST2.20130218.graphics.html">Display graphics.</A>
<BR>
<A HREF="/getgoes/?id=shef&station=MYST2&date=20130218">Display DCP transmissions.</A>
<HR>
<PRE>

SHEF ID: MYST2 Pat Mayse Lake
STATION TYPE: RESERVOIR
Flood Control Pool: Bottom = 451.00, Top = 460.50

PRECIP PRECIP(2) ELEVATION STORAGE INFLOW RELEASE AIR-TEMP WIND-DIRWIND-SPEED REL-HUMID SOLAR-RAD VOLTAGE BAT-LOAD
INCHES INCHES FEET ACFT CFS CFS DEG-F DEGREES MPH PERCENT W/M2 VOLTS VOLTS
GOES GOES GOES GOES COMPRESQ COMPRESQ GOES GOES GOES GOES GOES GOES GOES
(Cen)
02/18 01:00 0.00 0.00 447.00 96402 9 0 55.20 173.00 18.02 56.37 0.00 12.99 12.83
02/18 02:00 0.00 0.00 446.99 96352 4 0 55.74 169.60 17.20 60.82 0.00 12.96 12.77
02/18 03:00 0.00 0.00 447.03 96556 0 0 55.29 170.20 17.79 64.79 0.00 12.94 12.77
02/18 04:00 0.00 0.00 447.00 96402 0 0 55.08 166.60 21.41 68.76 0.00 12.93 12.71
02/18 05:00 0.00 0.00 446.99 96352 0 0 55.96 166.00 19.19 72.00 0.00 12.92 12.71
02/18 06:00 0.00 0.00 446.99 96352 0 0 55.08 159.30 14.64 74.56 0.00 12.92 12.71
02/18 07:00 0.00 0.00 446.99 96352 0 0 55.40 154.30 13.20 77.19 0.00 12.91 12.71
02/18 08:00 0.00 0.00 446.99 96352 61 0 55.96 157.70 12.84 78.65 10.00 12.92 12.71
02/18 09:00 0.00 0.00 447.00 96402 61 0 57.96 171.90 16.03 78.05 32.00 13.10 12.71
02/18 10:00 0.00 0.00 447.00 96402 185 0 58.71 180.90 18.72 78.66 57.00 13.46 12.89
02/18 11:00 0.00 0.00 447.02 96505 188 0 62.56 198.90 23.01 73.84 79.00 13.68 13.24
02/18 12:00 0.00 0.00 447.03 96556 188 0 63.77 197.60 24.16 71.14 428.00 14.17 13.48
02/18 13:00 0.00 0.00 447.07 96762 128 0 66.29 214.80 29.18 58.32 662.00 13.73 13.94
02/18 14:00 0.00 0.00 447.07 96762 128 0 68.27 225.70 26.96 52.27 489.00 13.69 13.53
02/18 15:00 0.00 0.00 447.10 96917 3 0 69.69 273.90 23.58 31.94 575.00 13.76 13.48
02/18 16:00 0.00 0.00 447.01 96454 0 0 68.94 286.00 19.61 29.62 462.00 13.83 13.53
02/18 17:00 0.00 0.00 447.01 96454 0 0 63.77 312.20 19.79 32.12 264.00 13.86 13.59
02/18 18:00 0.00 0.00 446.98 96302 0 0 59.70 321.70 16.90 37.19 47.00 13.71 13.65
02/18 19:00 0.00 0.00 446.99 96352 0 0 56.17 343.30 11.96 42.25 0.00 13.26 13.53
02/18 20:00 0.00 0.00 446.98 96302 0 0 53.44 343.30 10.10 46.47 0.00 13.12 13.07
02/18 21:00 0.00 0.00 446.99 96352 0 0 50.90 338.00 6.26 50.50 0.00 13.08 12.89
02/18 22:00 0.00 0.00 446.98 96302 0 0 49.59 335.90 6.32 51.17 0.00 13.05 12.89
02/18 23:00 0.00 0.00 446.98 96302 0 0 47.50 342.30 2.99 52.46 0.00 13.03 12.89
02/19 00:00 0.00 0.00 446.98 96302 0 0 45.95 347.50 6.09 53.49 0.00 13.01 12.65


</PRE>
<HR>
</BODY>
</HTML>
84 changes: 84 additions & 0 deletions test/files/usace/swtwc/DSNT2.current.html
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,84 @@


<HTML lang="en-US">
<HEAD>
<TITLE>DSNT2: Lake Texoma, Denison Dam (tabular)</TITLE>
<META This file generated by sys.argv[0] on 2017/08/25 at 16:12:23>
</HEAD>
<BODY>
<H2>DSNT2: <EM>Lake Texoma, Denison Dam</EM></H2>
<H4>Data processed at Fri Aug 25 2017 16:12 </H4>
<HR>
All information presented herein is the property of the government of the
United States of America and may be revised or deleted at any time without
prior notice.
<BR>
Dissemination of this information without the expressed written consent of
the Public Affairs Office, Tulsa District U.S. Army Corps of Engineers is
strictly prohibited.
<BR>
<STRONG>These data are gathered electronically and, as presented, have not
undergone any form of quality control. These data are not guaranteed to be
valid or correct.</STRONG>
<HR>
Go to <A HREF=http:\\www.swt-wc.usace.army.mil/>home page.</A>
<BR>
Go to <A HREF="./stations.php">station list.</A>
<P>
Upstream stations:
<UL>
<LI><A HREF="CWRO2.20170825.html">CWRO2 : Washita Rv at Cumberland Cut, nr Cumberland, OK, Hwy 199</A></LI>
<LI><A HREF="GSVT2.20170825.html">GSVT2 : Red River, Gainesville, TX</A></LI>
</UL>

Downstream station:
<UL>
<LI><A HREF="DSTT2.20170825.html">DSTT2 : Red River at Denison Dam nr Denison, TX</A></LI>
</UL>

<BR>
<A HREF="DSNT2.20170824.html">Previous Day</A>
<BR>
<A HREF="DSNT2.20170826.html">Next Day</A>
<BR>
<A HREF="DSNT2.current.html">Current Day</A>
<HR>
<PRE>

SHEF ID: DSNT2 Lake Texoma, Denison Dam
STATION TYPE: Reservoir
Normal Pool: Bottom = 590.00, Top = 616.85

PRECIP PRECIP(A) ELEVATION STORAGE TW-ELEV INFLOW RELEASE AIR-TEMP WIND-DIRWIND-SPEED REL-HUMID SOLAR-RAD VOLTAGE BAT-LOAD
in in ft ac-ft ft cfs cfs F deg mph % W/m2 volt volt
Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev Regi-Rev Regi-Rev Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev Ccp-Rev
(US/Central)
08/25 00:00 0.00 0.00 617.90 2585386 508.67 5230 10069 75.60 109.60 6.01 82.04 0.00 13.73 13.18
08/25 01:00 0.00 0.00 617.89 2584618 502.79 -901 -901 74.61 111.90 3.24 85.22 1.00 13.72 13.18
08/25 02:00 0.00 0.00 617.89 2584618 502.00 -901 -901 73.27 108.20 5.65 86.56 0.00 13.72 13.18
08/25 03:00 0.00 0.00 617.88 2583849 501.97 -901 -901 72.07 93.10 2.83 89.55 0.00 13.72 13.18
08/25 04:00 0.00 0.00 617.88 2583849 501.97 -901 -901 71.96 110.90 4.25 87.29 0.00 13.72 13.18
08/25 05:00 0.00 0.00 617.88 2583849 501.97 -901 -901 72.18 109.60 6.12 81.86 0.00 13.72 13.18
08/25 06:00 0.00 0.00 617.86 2582313 504.50 -901 -901 71.96 107.90 6.39 77.95 1.00 13.72 13.18
08/25 07:00 0.00 0.00 617.89 2584618 509.66 -901 -901 70.86 107.80 4.77 79.29 2.00 13.72 13.18
08/25 08:00 0.00 0.00 617.88 2583849 509.88 -901 -901 70.65 109.60 6.14 77.83 64.00 13.72 13.18
08/25 09:00 0.00 0.00 617.87 2583081 509.86 -901 -901 71.85 112.20 6.36 73.98 108.00 13.72 13.18
08/25 10:00 0.00 0.00 617.85 2581544 509.88 -901 -901 74.39 108.80 8.57 67.27 320.00 13.72 13.18
08/25 11:00 0.00 0.00 617.86 2582313 509.88 -901 -901 77.45 103.00 5.56 62.08 566.00 13.72 13.18
08/25 12:00 0.00 0.00 617.85 2581544 509.87 -901 -901 79.21 112.40 6.97 60.55 524.00 13.72 13.18
08/25 13:00 0.00 0.00 617.86 2582313 509.88 -901 -901 81.97 122.80 6.66 58.97 1128.00 13.72 13.18
08/25 14:00 0.00 0.00 617.84 2580776 509.87 -901 -901 81.86 106.40 6.95 57.14 886.00 13.72 13.18
08/25 15:00 0.00 0.00 617.84 2580776 509.90 -901 -901 83.39 123.70 7.21 56.65 723.00 13.72 13.18
08/25 16:00 ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----
08/25 17:00 ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----
08/25 18:00 ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----
08/25 19:00 ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----
08/25 20:00 ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----
08/25 21:00 ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----
08/25 22:00 ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----
08/25 23:00 ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ---- ----

</PRE>
<HR>
</BODY>
</HTML>
Loading