Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stop logging pool low warnings in the log #287

Merged
merged 6 commits into from
Jan 27, 2025

Conversation

Cruikshanks
Copy link
Member

Anyone who has had to tail or dig into the water-abstraction-import logs will have had to wade through reams of this.

0|import  | 2025-01-27T15:30:24.002Z - info: Pool low on connections::Total:20,Idle:0,Waiting:10
0|import  | 2025-01-27T15:30:24.002Z - info: Pool low on connections::Total:20,Idle:0,Waiting:9
0|import  | 2025-01-27T15:30:24.003Z - info: Pool low on connections::Total:20,Idle:0,Waiting:8
0|import  | 2025-01-27T15:30:24.004Z - info: Pool low on connections::Total:20,Idle:0,Waiting:7
0|import  | 2025-01-27T15:30:24.004Z - info: Pool low on connections::Total:20,Idle:0,Waiting:6
0|import  | 2025-01-27T15:30:24.005Z - info: Pool low on connections::Total:20,Idle:0,Waiting:5
0|import  | 2025-01-27T15:30:24.006Z - info: Pool low on connections::Total:20,Idle:0,Waiting:4
0|import  | 2025-01-27T15:30:24.006Z - info: Pool low on connections::Total:20,Idle:0,Waiting:3
0|import  | 2025-01-27T15:30:24.006Z - info: Pool low on connections::Total:20,Idle:0,Waiting:2
0|import  | 2025-01-27T15:30:24.006Z - info: Pool low on connections::Total:20,Idle:0,Waiting:1
0|import  | 2025-01-27T15:30:24.007Z - info: Pool low on connections::Total:20,Idle:0,Waiting:5
0|import  | 2025-01-27T15:30:24.008Z - info: Pool low on connections::Total:20,Idle:0,Waiting:4
0|import  | 2025-01-27T15:30:24.008Z - info: Pool low on connections::Total:20,Idle:0,Waiting:3
0|import  | 2025-01-27T15:30:24.009Z - info: Pool low on connections::Total:20,Idle:0,Waiting:2
0|import  | 2025-01-27T15:30:24.009Z - info: Pool low on connections::Total:20,Idle:0,Waiting:1
0|import  | 2025-01-27T15:30:54.040Z - info: Pool low on connections::Total:20,Idle:0,Waiting:10
0|import  | 2025-01-27T15:30:54.040Z - info: Pool low on connections::Total:20,Idle:0,Waiting:9
0|import  | 2025-01-27T15:30:54.040Z - info: Pool low on connections::Total:20,Idle:0,Waiting:8
0|import  | 2025-01-27T15:30:54.041Z - info: Pool low on connections::Total:20,Idle:0,Waiting:7
0|import  | 2025-01-27T15:30:54.042Z - info: Pool low on connections::Total:20,Idle:0,Waiting:6
0|import  | 2025-01-27T15:30:54.042Z - info: Pool low on connections::Total:20,Idle:0,Waiting:5
0|import  | 2025-01-27T15:30:54.042Z - info: Pool low on connections::Total:20,Idle:0,Waiting:4
0|import  | 2025-01-27T15:30:54.043Z - info: Pool low on connections::Total:20,Idle:0,Waiting:3
0|import  | 2025-01-27T15:30:54.043Z - info: Pool low on connections::Total:20,Idle:0,Waiting:2
0|import  | 2025-01-27T15:30:54.043Z - info: Pool low on connections::Total:20,Idle:0,Waiting:1

Each night, this makes thousands of appearances in the logs. At this time, we don't have the capacity to rebuild how they have made their connection to the DB. But we can stop this message from appearing and swamping the entries we want to see.

Anyone who has had to tail or dig into the [water-abstraction-import](https://github.com/DEFRA/water-abstraction-import) logs will have had to wade through reams of this.

```text
0|import  | 2025-01-27T15:30:24.002Z - info: Pool low on connections::Total:20,Idle:0,Waiting:10
0|import  | 2025-01-27T15:30:24.002Z - info: Pool low on connections::Total:20,Idle:0,Waiting:9
0|import  | 2025-01-27T15:30:24.003Z - info: Pool low on connections::Total:20,Idle:0,Waiting:8
0|import  | 2025-01-27T15:30:24.004Z - info: Pool low on connections::Total:20,Idle:0,Waiting:7
0|import  | 2025-01-27T15:30:24.004Z - info: Pool low on connections::Total:20,Idle:0,Waiting:6
0|import  | 2025-01-27T15:30:24.005Z - info: Pool low on connections::Total:20,Idle:0,Waiting:5
0|import  | 2025-01-27T15:30:24.006Z - info: Pool low on connections::Total:20,Idle:0,Waiting:4
0|import  | 2025-01-27T15:30:24.006Z - info: Pool low on connections::Total:20,Idle:0,Waiting:3
0|import  | 2025-01-27T15:30:24.006Z - info: Pool low on connections::Total:20,Idle:0,Waiting:2
0|import  | 2025-01-27T15:30:24.006Z - info: Pool low on connections::Total:20,Idle:0,Waiting:1
0|import  | 2025-01-27T15:30:24.007Z - info: Pool low on connections::Total:20,Idle:0,Waiting:5
0|import  | 2025-01-27T15:30:24.008Z - info: Pool low on connections::Total:20,Idle:0,Waiting:4
0|import  | 2025-01-27T15:30:24.008Z - info: Pool low on connections::Total:20,Idle:0,Waiting:3
0|import  | 2025-01-27T15:30:24.009Z - info: Pool low on connections::Total:20,Idle:0,Waiting:2
0|import  | 2025-01-27T15:30:24.009Z - info: Pool low on connections::Total:20,Idle:0,Waiting:1
0|import  | 2025-01-27T15:30:54.040Z - info: Pool low on connections::Total:20,Idle:0,Waiting:10
0|import  | 2025-01-27T15:30:54.040Z - info: Pool low on connections::Total:20,Idle:0,Waiting:9
0|import  | 2025-01-27T15:30:54.040Z - info: Pool low on connections::Total:20,Idle:0,Waiting:8
0|import  | 2025-01-27T15:30:54.041Z - info: Pool low on connections::Total:20,Idle:0,Waiting:7
0|import  | 2025-01-27T15:30:54.042Z - info: Pool low on connections::Total:20,Idle:0,Waiting:6
0|import  | 2025-01-27T15:30:54.042Z - info: Pool low on connections::Total:20,Idle:0,Waiting:5
0|import  | 2025-01-27T15:30:54.042Z - info: Pool low on connections::Total:20,Idle:0,Waiting:4
0|import  | 2025-01-27T15:30:54.043Z - info: Pool low on connections::Total:20,Idle:0,Waiting:3
0|import  | 2025-01-27T15:30:54.043Z - info: Pool low on connections::Total:20,Idle:0,Waiting:2
0|import  | 2025-01-27T15:30:54.043Z - info: Pool low on connections::Total:20,Idle:0,Waiting:1
```

Each night, this makes thousands of appearances in the logs. At this time we don't have the capacity of rebuilding _how_ they have made their connection to the DB. But we can certainly stop this message from appearing and swamping the actual entries we want to see.
@Cruikshanks Cruikshanks added the housekeeping Refactoring, tidying up or other work which supports the project label Jan 27, 2025
@Cruikshanks Cruikshanks self-assigned this Jan 27, 2025
@Cruikshanks Cruikshanks marked this pull request as ready for review January 27, 2025 20:05
@Cruikshanks Cruikshanks merged commit d13e904 into main Jan 27, 2025
5 checks passed
@Cruikshanks Cruikshanks deleted the stop-logging-pool-low-warnings branch January 27, 2025 20:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
housekeeping Refactoring, tidying up or other work which supports the project
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant