-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathapp.log
240 lines (240 loc) · 18.5 KB
/
app.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
2023-04-28 07:09:55,568 [INFO] Loading csv data from file...
2023-04-28 07:09:55,720 [INFO] Converting datetime column to date format...
2023-04-28 07:09:55,727 [INFO] Connecting to database...
2023-04-28 07:09:55,758 [INFO] Creating schema...
2023-04-28 07:09:55,772 [INFO] Dropping the table if exists...
2023-04-28 07:09:55,783 [INFO] Creating table...
2023-04-28 07:09:55,810 [INFO] Loading table into db...
2023-04-28 07:09:59,401 [INFO] Committing changes to database...
2023-04-28 07:09:59,410 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:09:59,418 [INFO] Data load successful.
2023-04-28 07:09:59,424 [INFO] Loading xlsx data from file...
2023-04-28 07:12:17,741 [INFO] Dropping unwanted columns & filling the blanks...
2023-04-28 07:12:18,642 [INFO] Connecting to database...
2023-04-28 07:12:18,675 [INFO] Creating schema...
2023-04-28 07:12:18,685 [INFO] Dropping the table if exists...
2023-04-28 07:12:18,694 [INFO] Creating table...
2023-04-28 07:12:18,892 [INFO] Loading table into db...
2023-04-28 07:14:02,901 [INFO] Updating the table...
2023-04-28 07:14:17,685 [INFO] Dropping unwanted columns...
2023-04-28 07:14:17,712 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:14:17,749 [INFO] Data load successful.
2023-04-28 07:14:17,749 [INFO] Committing changes to database...
2023-04-28 07:14:17,749 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:14:17,761 [INFO] Data load successful.
2023-04-28 07:14:17,840 [INFO] Loading xlsx data from file...
2023-04-28 07:14:20,292 [INFO] Converting 'year' column to date format...
2023-04-28 07:14:20,294 [INFO] Connecting to database...
2023-04-28 07:14:20,334 [INFO] Creating schema...
2023-04-28 07:14:20,344 [INFO] Dropping the table if exists...
2023-04-28 07:14:20,354 [INFO] Creating table...
2023-04-28 07:14:20,379 [INFO] Loading table into db...
2023-04-28 07:14:21,933 [INFO] Committing changes to database...
2023-04-28 07:14:21,967 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:14:21,976 [INFO] Data load successful.
2023-04-28 07:14:21,983 [INFO] Loading xlsx data from file...
2023-04-28 07:14:28,906 [INFO] Converting 'year' column to date format...
2023-04-28 07:14:28,909 [INFO] Connecting to database...
2023-04-28 07:14:28,941 [INFO] Creating schema...
2023-04-28 07:14:28,953 [INFO] Dropping the table if exists...
2023-04-28 07:14:28,964 [INFO] Creating table...
2023-04-28 07:14:28,987 [INFO] Loading table into db...
2023-04-28 07:14:33,304 [INFO] Committing changes to database...
2023-04-28 07:14:33,310 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:14:33,319 [INFO] Data load successful.
2023-04-28 07:14:33,367 [INFO] Loading xlsx data from file...
2023-04-28 07:14:34,926 [INFO] Converting 'year' column to date format...
2023-04-28 07:14:34,929 [INFO] Connecting to database...
2023-04-28 07:14:34,951 [INFO] Creating schema...
2023-04-28 07:14:35,004 [INFO] Dropping the table if exists...
2023-04-28 07:14:35,016 [INFO] Creating table...
2023-04-28 07:14:35,077 [INFO] Loading table into db...
2023-04-28 07:14:36,304 [INFO] Committing changes to database...
2023-04-28 07:14:36,368 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:14:36,378 [INFO] Data load successful.
2023-04-28 07:14:36,384 [INFO] Loading data from PDF file: data/GTI-2022-web.pdf
2023-04-28 07:14:37,156 [INFO] Connecting to database...
2023-04-28 07:14:37,189 [INFO] Creating schema...
2023-04-28 07:14:37,200 [INFO] Dropping the table if it exists...
2023-04-28 07:14:37,212 [INFO] Creating table...
2023-04-28 07:14:37,236 [INFO] Loading data into db...
2023-04-28 07:14:37,249 [INFO] Committing changes to database...
2023-04-28 07:14:37,255 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:14:37,263 [INFO] Data load successful.
2023-04-28 07:14:37,268 [INFO] Loading data from PDF file: data/GTI-2023-web.pdf
2023-04-28 07:14:37,618 [INFO] Connecting to database...
2023-04-28 07:14:37,637 [INFO] Creating schema...
2023-04-28 07:14:37,648 [INFO] Dropping the table if it exists...
2023-04-28 07:14:37,658 [INFO] Creating table...
2023-04-28 07:14:37,680 [INFO] Loading data into db...
2023-04-28 07:14:37,693 [INFO] Committing changes to database...
2023-04-28 07:14:37,699 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:14:37,706 [INFO] Data load successful.
2023-04-28 07:14:37,711 [INFO] Loading data from World Bank API...
2023-04-28 07:14:37,714 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:38,530 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/GV.POLI.ST.ES?format=json&per_page=18000 HTTP/1.1" 200 715196
2023-04-28 07:14:39,069 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:39,884 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/RL.PER.RNK.UPPER?format=json&per_page=18000 HTTP/1.1" 200 1279384
2023-04-28 07:14:40,478 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:41,312 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/RL.PER.RNK.LOWER?format=json&per_page=18000 HTTP/1.1" 200 1282342
2023-04-28 07:14:41,907 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:42,755 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/PV.PER.RNK.LOWER?format=json&per_page=18000 HTTP/1.1" 200 1497115
2023-04-28 07:14:43,351 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:44,126 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/IC.CNS.CRIM.ZS?format=json&per_page=18000 HTTP/1.1" 200 779071
2023-04-28 07:14:44,600 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:45,455 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/RL.NO.SRC?format=json&per_page=18000 HTTP/1.1" 200 998735
2023-04-28 07:14:46,036 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:47,121 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/VC.IHR.PSRC.FE.P5?format=json&per_page=18000 HTTP/1.1" 200 3924262
2023-04-28 07:14:48,028 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:48,906 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/PV.EST?format=json&per_page=18000 HTTP/1.1" 200 1225346
2023-04-28 07:14:49,512 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:50,374 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/PV.PER.RNK.UPPER?format=json&per_page=18000 HTTP/1.1" 200 1493684
2023-04-28 07:14:50,984 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:51,731 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/GV.RULE.LW.ES?format=json&per_page=18000 HTTP/1.1" 200 648490
2023-04-28 07:14:52,230 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:53,075 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/RL.STD.ERR?format=json&per_page=18000 HTTP/1.1" 200 1062551
2023-04-28 07:14:53,668 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:54,412 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/GCI.1STPILLAR.XQ?format=json&per_page=18000 HTTP/1.1" 200 655059
2023-04-28 07:14:54,883 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:55,738 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/PV.PER.RNK?format=json&per_page=18000 HTTP/1.1" 200 1272198
2023-04-28 07:14:56,337 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:57,159 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/PV.STD.ERR?format=json&per_page=18000 HTTP/1.1" 200 1273702
2023-04-28 07:14:57,755 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:58,537 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/MO.INDEX.SRLW.XQ?format=json&per_page=18000 HTTP/1.1" 200 657034
2023-04-28 07:14:59,014 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:14:59,826 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/RL.EST?format=json&per_page=18000 HTTP/1.1" 200 1014510
2023-04-28 07:15:00,443 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:15:01,200 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/IC.FRM.OBS.OBST6?format=json&per_page=18000 HTTP/1.1" 200 566804
2023-04-28 07:15:01,667 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:15:02,441 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/IC.FRM.CRM.CRIME8?format=json&per_page=18000 HTTP/1.1" 200 567002
2023-04-28 07:15:02,907 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:15:04,051 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/VC.IHR.PSRC.P5?format=json&per_page=18000 HTTP/1.1" 200 3759939
2023-04-28 07:15:04,923 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:15:06,084 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/VC.IHR.PSRC.MA.P5?format=json&per_page=18000 HTTP/1.1" 200 3858439
2023-04-28 07:15:06,966 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:15:07,804 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/RL.PER.RNK?format=json&per_page=18000 HTTP/1.1" 200 1057514
2023-04-28 07:15:08,401 [DEBUG] Starting new HTTPS connection (1): api.worldbank.org:443
2023-04-28 07:15:09,301 [DEBUG] https://api.worldbank.org:443 "GET /v2/country/all/indicator/PV.NO.SRC?format=json&per_page=18000 HTTP/1.1" 200 1207963
2023-04-28 07:15:10,052 [INFO] Connecting to database...
2023-04-28 07:15:10,082 [INFO] Creating schema...
2023-04-28 07:15:10,097 [INFO] Dropping the table if it exists...
2023-04-28 07:15:10,107 [INFO] Creating table...
2023-04-28 07:15:10,130 [INFO] Loading data into db...
2023-04-28 07:15:13,986 [INFO] Committing changes to database...
2023-04-28 07:15:13,992 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:15:14,000 [INFO] Data load successful.
2023-04-28 07:15:14,051 [INFO] Loading data from Knoema API: UNODCIBTHS2019
2023-04-28 07:15:18,287 [INFO] Connecting to database...
2023-04-28 07:15:18,308 [INFO] Creating schema...
2023-04-28 07:15:18,319 [INFO] Dropping the table if it exists...
2023-04-28 07:15:18,329 [INFO] Creating table...
2023-04-28 07:15:18,355 [INFO] Loading data into db...
2023-04-28 07:15:18,689 [INFO] Committing changes to database...
2023-04-28 07:15:18,695 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:15:18,702 [INFO] Data load successful.
2023-04-28 07:15:18,707 [INFO] Loading data from Knoema API: WLDHFI2022
2023-04-28 07:15:59,511 [INFO] Connecting to database...
2023-04-28 07:15:59,565 [INFO] Creating schema...
2023-04-28 07:15:59,576 [INFO] Dropping the table if it exists...
2023-04-28 07:15:59,587 [INFO] Creating table...
2023-04-28 07:15:59,612 [INFO] Loading data into db...
2023-04-28 07:16:10,860 [INFO] Committing changes to database...
2023-04-28 07:16:10,886 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:16:10,895 [INFO] Data load successful.
2023-04-28 07:16:10,903 [INFO] Loading data from Knoema API: WFGCI2019
2023-04-28 07:18:50,045 [INFO] Connecting to database...
2023-04-28 07:18:50,081 [INFO] Creating schema...
2023-04-28 07:18:50,093 [INFO] Dropping the table if it exists...
2023-04-28 07:18:50,103 [INFO] Creating table...
2023-04-28 07:18:50,130 [INFO] Loading data into db...
2023-04-28 07:19:19,201 [INFO] Committing changes to database...
2023-04-28 07:19:19,208 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:19:19,216 [INFO] Data load successful.
2023-04-28 07:19:19,230 [INFO] Loading data from Google Sheets: 1WVhqxCwiw9F2Z5X0nfQBztcNTT90S8kdDDIxZanMnNY
2023-04-28 07:19:19,244 [INFO] file_cache is only supported with oauth2client<4.0.0
2023-04-28 07:19:19,382 [DEBUG] URL being requested: GET https://sheets.googleapis.com/v4/spreadsheets/1WVhqxCwiw9F2Z5X0nfQBztcNTT90S8kdDDIxZanMnNY/values/Acronyms%21A1%3AZZ?alt=json
2023-04-28 07:19:19,855 [INFO] Refreshing credentials due to a 401 response. Attempt 1/2.
2023-04-28 07:19:19,856 [DEBUG] Making request: POST https://oauth2.googleapis.com/token
2023-04-28 07:19:21,682 [DEBUG] Term Overview Description Selected Notes
4 %R %Rotakin The percentage of a VSS monitoring screen take... TRUE We will provide users the option to add more a...
5 ABIED Ariel Borne Improvised Explosive Device TRUE NaN
6 AFFL Above Finished Floor Level TRUE NaN
7 AFR Automatic Facial Recognition A VSS application capable of identifying or ve... TRUE NaN
8 ANPR Automatic Number Plate Recognition Automatic number plate recognition is a techno... TRUE NaN
2023-04-28 07:19:21,694 [DEBUG] (67, 5)
2023-04-28 07:19:21,694 [INFO] Connecting to database...
2023-04-28 07:19:21,713 [INFO] Creating schema...
2023-04-28 07:19:21,728 [INFO] Dropping the table if it exists...
2023-04-28 07:19:21,741 [INFO] Creating table...
2023-04-28 07:19:21,765 [INFO] Loading data into db...
2023-04-28 07:19:21,782 [INFO] Committing changes to database...
2023-04-28 07:19:21,783 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:19:21,790 [INFO] Data load successful.
2023-04-28 07:19:21,795 [INFO] Loading data from Google Sheets: 1WVhqxCwiw9F2Z5X0nfQBztcNTT90S8kdDDIxZanMnNY
2023-04-28 07:19:21,797 [INFO] file_cache is only supported with oauth2client<4.0.0
2023-04-28 07:19:21,926 [DEBUG] URL being requested: GET https://sheets.googleapis.com/v4/spreadsheets/1WVhqxCwiw9F2Z5X0nfQBztcNTT90S8kdDDIxZanMnNY/values/Project%20Assets%21A1%3AZZ?alt=json
2023-04-28 07:19:22,341 [INFO] Refreshing credentials due to a 401 response. Attempt 1/2.
2023-04-28 07:19:22,341 [DEBUG] Making request: POST https://oauth2.googleapis.com/token
2023-04-28 07:19:22,974 [DEBUG] Master_Asset_List scope hotel notes
2 Electrical Rooms Substations & Infrastructure Physical TRUE At this stage we are asking users to confirm t...
3 MEP Cabinets Physical TRUE NaN
4 HVAC & Mechanical Rooms & Infrastructure Physical TRUE NaN
5 Fire Fighting Infrastructure Physical TRUE NaN
6 Emergency Exits Physical TRUE NaN
2023-04-28 07:19:22,983 [DEBUG] (44, 4)
2023-04-28 07:19:22,983 [INFO] Connecting to database...
2023-04-28 07:19:23,001 [INFO] Creating schema...
2023-04-28 07:19:23,026 [INFO] Dropping the table if it exists...
2023-04-28 07:19:23,036 [INFO] Creating table...
2023-04-28 07:19:23,062 [INFO] Loading data into db...
2023-04-28 07:19:23,079 [INFO] Committing changes to database...
2023-04-28 07:19:23,080 [INFO] Testing if data has been loaded successfully...
2023-04-28 07:19:23,087 [INFO] Data load successful.
2023-04-28 07:19:23,091 [INFO] Connecting to database...
2023-04-28 07:19:23,109 [INFO] Reading SQL script file...
2023-04-28 07:19:23,117 [INFO] Executing SQL script...
2023-04-28 07:19:23,174 [INFO] SQL script executed successfully.
2023-04-28 07:19:23,175 [INFO] Connecting to database...
2023-04-28 07:19:23,196 [INFO] Reading SQL script file...
2023-04-28 07:19:23,203 [INFO] Executing SQL script...
2023-04-28 07:19:23,231 [INFO] SQL script executed successfully.
2023-04-28 07:19:23,231 [INFO] Connecting to database...
2023-04-28 07:19:23,249 [INFO] Reading SQL script file...
2023-04-28 07:19:23,256 [INFO] Executing SQL script...
2023-04-28 07:19:23,272 [INFO] SQL script executed successfully.
2023-04-28 07:19:23,273 [INFO] Connecting to database...
2023-04-28 07:19:23,291 [INFO] Reading SQL script file...
2023-04-28 07:19:23,298 [INFO] Executing SQL script...
2023-04-28 07:19:39,377 [INFO] SQL script executed successfully.
2023-04-28 07:19:39,379 [INFO] Connecting to database...
2023-04-28 07:19:39,397 [INFO] Reading SQL script file...
2023-04-28 07:19:39,405 [INFO] Executing SQL script...
2023-04-28 07:19:50,476 [INFO] SQL script executed successfully.
2023-04-28 07:19:50,477 [INFO] Connecting to database...
2023-04-28 07:19:50,508 [INFO] Reading SQL script file...
2023-04-28 07:19:50,516 [INFO] Executing SQL script...
2023-04-28 07:19:51,411 [INFO] SQL script executed successfully.
2023-04-28 07:19:51,413 [INFO] Connecting to database...
2023-04-28 07:19:51,447 [INFO] Reading SQL script file...
2023-04-28 07:19:51,455 [INFO] Executing SQL script...
2023-04-28 07:20:40,286 [INFO] SQL script executed successfully.
2023-04-28 07:20:40,287 [INFO] Connecting to database...
2023-04-28 07:20:40,305 [INFO] Reading SQL script file...
2023-04-28 07:20:40,313 [INFO] Executing SQL script...
2023-04-28 07:20:40,339 [INFO] SQL script executed successfully.
2023-04-28 07:20:40,340 [INFO] Connecting to database...
2023-04-28 07:20:40,374 [INFO] Reading SQL script file...
2023-04-28 07:20:40,381 [INFO] Executing SQL script...
2023-04-28 07:20:40,403 [INFO] SQL script executed successfully.
2023-04-28 07:20:40,404 [INFO] Connecting to database...
2023-04-28 07:20:40,421 [INFO] Reading SQL script file...
2023-04-28 07:20:40,429 [INFO] Executing SQL script...
2023-04-28 07:20:40,449 [INFO] SQL script executed successfully.
2023-04-28 07:20:40,450 [INFO] Connecting to database...
2023-04-28 07:20:40,468 [INFO] Reading SQL script file...
2023-04-28 07:20:40,477 [INFO] Executing SQL script...
2023-04-28 07:20:40,499 [INFO] SQL script executed successfully.
2023-04-28 07:20:40,499 [INFO] Connecting to database...
2023-04-28 07:20:40,517 [INFO] Reading SQL script file...
2023-04-28 07:20:40,524 [INFO] Executing SQL script...
2023-04-28 07:20:40,542 [INFO] SQL script executed successfully.