-
Notifications
You must be signed in to change notification settings - Fork 1
/
energy_atlas.py
217 lines (170 loc) · 10.6 KB
/
energy_atlas.py
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
import geopandas as gpd
import requests
import streamlit as st
from langchain_core.prompts import PromptTemplate
from langchain_core.output_parsers import StrOutputParser
def process_energy_atlas_request(llm, user_input, spatial_datasets):
prompt = PromptTemplate(
template="""<|begin_of_text|><|start_header_id|>system<|end_header_id|>
[ Definition 1 ]
We have the following function to get coal mines from an ArcGIS Feature Service as a
GeoDataFrame:
load_coal_mines(where_condition)
The returned GeoDataFrame has the following columns:
'geometry', 'OBJECTID', 'MSHA_ID', 'MINE_NAME', 'MINE_TYPE',
'MINE_STATE', 'STATE', 'FIPS_COUNTY', 'MINE_COUNTY', 'PRODUCTION',
'PHYSICAL_UNIT', 'REFUSE', 'Source', 'PERIOD', 'Longitude', 'Latitude'
Use the column 'STATE' rather than the column 'MINE_STATE' to find coal mines in a state.
The values in the column 'STATE' are all in upper case like 'ALABAMA' or 'COLORADO' etc.
The column 'COUNTY' contains values like 'Walker' or 'Jefferson'.
To get all coal mines, call load_coal_mines with "1 = 1" as where_condition.
[ Definition 2 ]
We have the following functions to get coal power plants/wind power plants/battery storage plants/
geothermal power plants/hydro pumped storage power plants/natural gas power plants/nuclear power plants/
petroleum power plants/solar power plants from an ArcGIS Feature Service as a GeoDataFrame:
load_coal_power_plants(where_condition)
load_wind_power_plants(where_condition)
load_battery_storage_plants(where_condition)
load_geothermal_power_plants(where_condition)
load_hydro_pumped_storage_power_plants(where_condition)
load_natural_gas_power_plants(where_condition)
load_nuclear_power_plants(where_condition)
load_petroleum_power_plants(where_condition)
load_solar_power_plants(where_condition)
The returned GeoDataFrame has the following columns:
'geometry', 'OBJECTID', 'Plant_Code', 'Plant_Name', 'Utility_ID', 'Utility_Name', 'sector_name',
'Street_Address', 'City', 'County', 'State', 'Zip', 'PrimSource', 'source_desc', 'tech_desc',
'Install_MW', 'Total_MW', 'Bat_MW', 'Bio_MW', 'Coal_MW', 'Geo_MW', 'Hydro_MW', 'HydroPS_MW',
'NG_MW', 'Nuclear_MW', 'Crude_MW', 'Solar_MW', 'Wind_MW', 'Other_MW', 'Source', 'Period',
'Longitude', 'Latitude'
The values in the column 'State' are case sensitive like 'Nebraska' or 'Montana' or 'Kentucky' etc.
The column 'County' contains values like 'Adams' or 'Yellowstone'. The column 'Total_MW' gives the
Total Megawatts of the plants.
Note that use the case sensitive state names for the column 'State'.
[ Definition 3 ]
We have the following function to get renewable diesel fuel and other biofuel plants/biodiesel plants
from an ArcGIS Feature Service as a GeoDataFrame:
load_renewable_diesel_fuel_and_other_biofuel_plants(where_condition)
load_biodiesel_plants(where_condition)
The returned GeoDataFrame has the following columns:
'geometry', 'OBJECTID', 'Company', 'Site', 'State', 'PADD', 'Cap_Mmgal',
'Source', 'Period', 'Longitude', 'Latitude'
The values in the column 'State' are case sensitive like 'Nebraska' or 'Montana' etc.
To get all coal mines/coal power plants/wind power plants/renewable diesel fuel and
other biofuel plants and etc, call the correspondent function with "1 = 1" as where_condition.
[ Available Data ]
The following are the variables with the data:
{variables}
[ Question ]
The following is the question from the user:
{question}
Please return only the complete Python code in the following format to implement the user's request without preamble or
explanation.
# other code which do not change spatial_datasets
gdf = ......
gdf.title = ......
Don't include any print statement. Don't add ``` around the code. Make a title and save the title in gdf.title.
[ Example 1]
Find all coal mines along Ohio River.
Find out if one of the available variables is a geodataframe containing Ohio River.
If none of the available variables are geodataframes containing Ohio River, then return the following code:
raise Exception("The data for Ohio River is missing. Please load Ohio River first.")
If you found a variable which is a geodataframe containing Ohio River, then return the valid Python code in the
following format:
gdf1 = <replace by the variable of the geodataframe for Ohio River if you found one>
gdf2 = load_coal_mines("1 = 1")
# Keep the following line exactly as it is
distance_threshold = 0.2
gdf2['distance_to_river'] = gdf2.geometry.apply(lambda x: gdf1.distance(x).min())
gdf = gdf2[gdf2['distance_to_river'] <= distance_threshold]
gdf = gdf.drop(columns=['distance_to_river'])
gdf.title = "All Coal Mines within 10 Miles away from Ohio River"
[ Example 2 ]
Find all coal power plants along Ohio River.
Use the same way as Example 1 to implement it. Just replace load_coal_mines by load_coal_power_plants
and change the title. If none of the available variables are geodataframes containing Ohio River, then return the
code raising the execption.
[ Example 3 ]
If the request is for an attribute of a particular plant, first obtain the plant as gdf, and then store the answer
to the user in gdf.answer. For example, find the capacity of the coal power plant Rockport.
gdf = load_coal_power_plants("Plant_Name = 'Rockport'")
gdf.title = "The Coal Power Plant Rockport"
gdf.answer = f"The capacity of the coal power plant Rockport is {{gdf.iloc[0]['Total_MW']}} megawatt."
[ Note 1 ]
Use pandas.concat to concatenate two geodataframe gdf1 and gdf2:
gdf = pd.concat([gdf1, gdf2], ignore_index=True)
gdf = gpd.GeoDataFrame(gdf, geometry='geometry')
<|eot_id|><|start_header_id|>assistant<|end_header_id|>
""",
input_variables=["question", "variables"],
)
df_code_chain = prompt | llm | StrOutputParser()
variables = ""
if spatial_datasets:
for index, dataset in enumerate(spatial_datasets):
variables += f"""
st.session_state.datasets[{index}] holds a geodataframe after processing
the request: { st.session_state.datasets[index].label}
The following is the columns of st.session_state.datasets[{index}]:
{ st.session_state.datasets[index].dtypes }
The following is the first 5 rows of the data:
{ st.session_state.datasets[index].head(5).drop(columns='geometry').to_csv(index=False) }
"""
# st.code(variables)
return df_code_chain.invoke({"question": user_input, "variables": variables})
def load_features(self_url, where, wkid):
url_string = self_url + "/query?where={}&returnGeometry=true&outFields={}&f=geojson".format(where, '*')
resp = requests.get(url_string, verify=False)
data = resp.json()
if data['features']:
return gpd.GeoDataFrame.from_features(data['features'], crs=f'EPSG:{wkid}')
else:
return gpd.GeoDataFrame(columns=['geometry'], crs=f'EPSG:{wkid}')
def load_coal_mines(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/CoalMines_US_EIA/FeatureServer/247"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_coal_power_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Coal_Power_Plants/FeatureServer/0"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_wind_power_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Wind_Power_Plants/FeatureServer/0"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_renewable_diesel_fuel_and_other_biofuel_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Renewable_Diesel_and_Other_Biofuels/FeatureServer/245"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_battery_storage_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Battery_Storage_Plants/FeatureServer/0"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_geothermal_power_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Geothermal_Power_Plants/FeatureServer/0"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_hydro_pumped_storage_power_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Hydro_Pumped_Storage_Power_Plants/FeatureServer/0"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_natural_gas_power_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Natural_Gas_Power_Plants/FeatureServer/0"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_nuclear_power_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Nuclear_Power_Plants/FeatureServer/0"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_petroleum_power_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Petroleum_Power_Plants/FeatureServer/0"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_solar_power_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Solar_Power_Plants/FeatureServer/0"
wkid = "3857"
return load_features(self_url, where, wkid)
def load_biodiesel_plants(where):
self_url = "https://services7.arcgis.com/FGr1D95XCGALKXqM/ArcGIS/rest/services/Biodiesel_Plants_US_EIA/FeatureServer/113"
wkid = "3857"
return load_features(self_url, where, wkid)