-
Notifications
You must be signed in to change notification settings - Fork 107
/
Copy pathtask-configuration.md
93 lines (67 loc) · 2.24 KB
/
task-configuration.md
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
---
id: task-configuration
title: Configuration of Tasks
hide_title: false
---
The `cumulus` module exposes values for configuration for some of the provided archive and ingest tasks. Currently the following are available as configurable variables:
## cmr_search_client_config
Configuration parameters for CMR search client for cumulus archive module tasks in the form:
```hcl
<lambda_identifier>_report_cmr_limit = <maximum number records can be returned from cmr-client search, this should be greater than cmr_page_size>
<lambda_identifier>_report_cmr_page_size = <number of records for each page returned from CMR>
type = map(string)
```
More information about cmr limit and cmr page_size can be found from [@cumulus/cmr-client](https://github.com/nasa/cumulus/blob/master/packages/cmr-client/src/searchConcept.ts) and [CMR Search API document](https://cmr.earthdata.nasa.gov/search/site/docs/search/api.html#query-parameters).
Currently the following values are supported:
- create_reconciliation_report_cmr_limit
- create_reconciliation_report_cmr_page_size
### Example
```tf
cmr_search_client_config = {
create_reconciliation_report_cmr_limit = 2500
create_reconciliation_report_cmr_page_size = 250
}
```
## elasticsearch_client_config
Configuration parameters for Elasticsearch client for cumulus archive module tasks in the form:
```hcl
<lambda_identifier>_es_scroll_duration = <duration>
<lambda_identifier>_es_scroll_size = <size>
type = map(string)
```
Currently the following values are supported:
- create_reconciliation_report_es_scroll_duration
- create_reconciliation_report_es_scroll_size
### Example
```tf
elasticsearch_client_config = {
create_reconciliation_report_es_scroll_duration = "15m"
create_reconciliation_report_es_scroll_size = 2000
}
```
## lambda_timeouts
An optional configurable map of timeouts (in seconds) for cumulus lambdas in the form:
```hcl
lambda_timeouts = {
<lambda_name> = <timeout>
}
```
### Example
```tf
lambda_timeouts = {
sqsMessageRemover = 300
}
```
## lambda_memory_sizes
An optional configurable map of memory sizes (in MBs) for cumulus lambdas in the form:
```hcl
lambda_memory_sizes = {
<lambda_name> = <memory_size>
}
```
### Example
```tf
lambda_memory_sizes = {
SyncGranule = 1024
}
```