Custom Scripts Docker Images
Currently, Treasure Workflow supports following Docker images:
- digdag/digdag-python:3.9.22-td1 [current stable]
- digdag/digdag-python:3.10.1 (3.10)
- digdag/digdag-python:3.9.2
- digdag/digdag-python:3.9.1 (3.9)
Images other than 3.9.22-td1 contain some security vulnerabilities, so we do not recommend using them from now on. We recommend upgrading the 3.9, 3.9.1, and 3.9.2 images to 3.9.22-td1.
Installed python and library versions
The Python libraries installed in the Custom Script Docker image are divided into two groups: "required libraries" and "installed libraries".
“required libraries” are libraries listed in requirements.txt.
They are installed as long as the Python minor version is the same.
For example, the pystan library is in the "required libraries" of the 3.9.1 image,
so you can expect 3.9.77-td88 image will contain the pystan library.
However, 3.10.88-td99 image may not contain the pystan library.
On the other hand, “installed libraries” include dependencies of required libraries as well as required libraries. The libraries other than required libraries may not exist in the next version of the image.
digdag/digdag-python:3.9.22-td1 [current stable]
- Python 3.9.22
- required libraries:
boto3
fbprophet
futures
hyperopt
lightgbm
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm- installed libraries:
Package Version
--------------------- ---------
alembic 1.5.8
attrs 20.3.0
boto3 1.26.132
botocore 1.29.132
certifi 2025.4.26
chardet 4.0.0
click 7.1.2
cliff 3.5.0
cloudpickle 1.6.0
cmaes 0.8.2
cmd2 1.5.0
cmdstanpy 0.9.5
colorama 0.4.4
colorlog 4.8.0
convertdate 2.2.0
cycler 0.10.0
Cython 0.29.22
ephem 3.7.7.1
fbprophet 0.7.1
future 0.18.3
futures 3.1.1
greenlet 1.0.0
holidays 0.10.4
hyperopt 0.2.5
idna 2.10
iniconfig 1.1.1
jmespath 0.10.0
joblib 1.1.1
kiwisolver 1.3.1
korean-lunar-calendar 0.2.1
lightgbm 4.6.0
LunarCalendar 0.0.9
Mako 1.1.4
MarkupSafe 1.1.1
matplotlib 3.4.1
memory-profiler 0.58.0
msgpack 1.0.2
networkx 2.6
nltk 3.9.1
numpy 1.20.2
optuna 2.7.0
packaging 20.9
pandas 1.3.0
pbr 5.5.1
pillow 10.3.0
pip 25.1.1
plotly 4.14.3
pluggy 0.13.1
presto-python-client 0.7.0
prettytable 0.7.2
psutil 5.8.0
py 1.10.0
py4j 0.10.9.7
pyarrow 14.0.1
PyMeeus 0.5.11
pyparsing 2.4.7
pyperclip 1.8.2
pyspark 3.5.5
pystan 2.19.1.1
pytd 1.5.2
pytest 6.2.3
python-dateutil 2.8.1
python-editor 1.0.4
pytz 2019.3
PyYAML 5.4.1
regex 2021.8.3
requests 2.25.1
retrying 1.3.3
s3transfer 0.6.1
scikit-learn 0.24.1
scipy 1.8.0
seaborn 0.11.1
setuptools 58.1.0
setuptools-git 1.2
simplejson 3.17.2
six 1.15.0
SQLAlchemy 1.4.5
stevedore 3.3.0
td-client 1.2.1
td-pyspark 21.3.0
td-pyspark-ea 20.12.0
threadpoolctl 2.1.0
toml 0.10.2
tqdm 4.60.0
urllib3 1.26.0
wcwidth 0.2.5
wheel 0.45.1digdag/digdag-python:3.10.1 (3.10)
- Python 3.10.11
- required libraries:
boto3
convertdate
Cython
futures
holidays
hyperopt
lightgbm
lunarcalendar
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
prophet
pyarrow
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm- installed libraries:
Package Version
--------------------- --------
aiohttp 3.8.4
aiosignal 1.3.1
alembic 1.10.4
appdirs 1.4.4
async-timeout 4.0.2
attrs 23.1.0
boto3 1.26.132
botocore 1.29.132
certifi 2023.5.7
charset-normalizer 3.1.0
click 8.1.3
clikit 0.6.2
cloudpickle 2.2.1
cmaes 0.9.1
cmdstanpy 1.1.0
colorlog 6.7.0
contourpy 1.0.7
convertdate 2.4.0
crashtest 0.3.1
cycler 0.11.0
Cython 0.29.34
ephem 4.1.4
exceptiongroup 1.1.1
fonttools 4.39.4
frozenlist 1.3.3
future 0.18.3
futures 3.0.5
greenlet 2.0.2
hijri-converter 2.3.1
holidays 0.24
httpstan 4.10.0
hyperopt 0.2.7
idna 3.4
iniconfig 2.0.0
jmespath 1.0.1
joblib 1.2.0
kiwisolver 1.4.4
korean-lunar-calendar 0.3.1
lightgbm 3.3.5
LunarCalendar 0.0.9
Mako 1.2.4
MarkupSafe 2.1.2
marshmallow 3.19.0
matplotlib 3.7.1
memory-profiler 0.61.0
msgpack 1.0.5
multidict 6.0.4
networkx 3.1
nltk 3.8.1
numpy 1.23.5
optuna 3.1.1
packaging 23.1
pandas 1.5.3
pastel 0.2.1
Pillow 9.5.0
pip 23.1.2
plotly 5.14.1
pluggy 1.0.0
presto-python-client 0.8.3
prophet 1.1.2
psutil 5.9.5
py4j 0.10.9.7
pyarrow 12.0.0
pylev 1.4.0
PyMeeus 0.5.12
pyparsing 3.0.9
pysimdjson 5.0.2
pyspark 3.4.0
pystan 3.7.0
pytd 1.5.1
pytest 7.3.1
python-dateutil 2.8.2
pytz 2023.3
PyYAML 6.0
regex 2023.5.5
requests 2.30.0
s3transfer 0.6.1
scikit-learn 1.2.2
scipy 1.10.1
seaborn 0.12.2
setuptools 65.5.1
simplejson 3.19.1
six 1.16.0
SQLAlchemy 2.0.13
td-client 1.2.1
td-pyspark 22.7.1
td-pyspark-ea 20.12.0
tenacity 8.2.2
threadpoolctl 3.1.0
tomli 2.0.1
tqdm 4.65.0
typing_extensions 4.5.0
urllib3 1.26.15
webargs 8.2.0
wheel 0.38.4
yarl 1.9.2digdag/digdag-python:3.9.2
- Python 3.9.16
- required libraries:
boto3
fbprophet
futures
hyperopt
lightgbm
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm- installed libraries:
Package Version
--------------------- ---------
alembic 1.5.8
attrs 20.3.0
boto3 1.26.132
botocore 1.29.132
certifi 2020.12.5
chardet 4.0.0
click 7.1.2
cliff 3.5.0
cloudpickle 1.6.0
cmaes 0.8.2
cmd2 1.5.0
cmdstanpy 0.9.5
colorama 0.4.4
colorlog 4.8.0
convertdate 2.2.0
cycler 0.10.0
Cython 0.29.22
ephem 3.7.7.1
fbprophet 0.7.1
future 0.18.3
futures 3.1.1
greenlet 1.0.0
holidays 0.10.4
hyperopt 0.2.5
idna 2.10
iniconfig 1.1.1
jmespath 0.10.0
joblib 1.1.1
kiwisolver 1.3.1
korean-lunar-calendar 0.2.1
lightgbm 3.2.0
LunarCalendar 0.0.9
Mako 1.1.4
MarkupSafe 1.1.1
matplotlib 3.4.1
memory-profiler 0.58.0
msgpack 1.0.2
networkx 2.6
nltk 3.6.6
numpy 1.20.2
optuna 2.7.0
packaging 20.9
pandas 1.3.0
pbr 5.5.1
Pillow 9.0.0
pip 23.1.2
plotly 4.14.3
pluggy 0.13.1
presto-python-client 0.7.0
prettytable 0.7.2
psutil 5.8.0
py 1.10.0
py4j 0.10.9.7
pyarrow 12.0.0
PyMeeus 0.5.11
pyparsing 2.4.7
pyperclip 1.8.2
pyspark 3.4.0
pystan 2.19.1.1
pytd 1.5.1
pytest 6.2.3
python-dateutil 2.8.1
python-editor 1.0.4
pytz 2019.3
PyYAML 5.4.1
regex 2021.8.3
requests 2.25.1
retrying 1.3.3
s3transfer 0.6.1
scikit-learn 0.24.1
scipy 1.6.2
seaborn 0.11.1
setuptools 58.1.0
setuptools-git 1.2
simplejson 3.17.2
six 1.15.0
SQLAlchemy 1.4.5
stevedore 3.3.0
td-client 1.2.1
td-pyspark 21.3.0
td-pyspark-ea 20.12.0
threadpoolctl 2.1.0
toml 0.10.2
tqdm 4.60.0
urllib3 1.26.0
wcwidth 0.2.5
wheel 0.40.0digdag/digdag-python:3.9.1 (3.9)
- Python 3.9.15
- required libraries:
boto3
fbprophet
futures
hyperopt
lightgbm
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm- installed libraries:
Package Version
--------------------- ---------
alembic 1.5.8
attrs 20.3.0
boto3 1.15.18
botocore 1.18.18
certifi 2020.12.5
chardet 4.0.0
click 7.1.2
cliff 3.5.0
cloudpickle 1.6.0
cmaes 0.8.2
cmd2 1.5.0
cmdstanpy 0.9.5
colorama 0.4.4
colorlog 4.8.0
convertdate 2.2.0
cycler 0.10.0
Cython 0.29.22
decorator 4.4.2
ephem 3.7.7.1
fbprophet 0.7.1
future 0.18.2
futures 3.1.1
greenlet 1.0.0
holidays 0.10.4
hyperopt 0.2.5
idna 2.10
iniconfig 1.1.1
jmespath 0.10.0
joblib 1.0.1
kiwisolver 1.3.1
korean-lunar-calendar 0.2.1
lightgbm 3.2.0
LunarCalendar 0.0.9
Mako 1.1.4
MarkupSafe 1.1.1
matplotlib 3.4.1
memory-profiler 0.58.0
msgpack 1.0.2
networkx 2.5.1
nltk 3.5
numpy 1.20.2
optuna 2.7.0
packaging 20.9
pandas 1.2.3
pbr 5.5.1
Pillow 8.2.0
pip 22.3.1
plotly 4.14.3
pluggy 0.13.1
presto-python-client 0.7.0
prettytable 0.7.2
psutil 5.8.0
py 1.10.0
py4j 0.10.9
pyarrow 3.0.0
PyMeeus 0.5.11
pyparsing 2.4.7
pyperclip 1.8.2
pyspark 3.1.1
pystan 2.19.1.1
pytd 1.4.0
pytest 6.2.3
python-dateutil 2.8.1
python-editor 1.0.4
pytz 2019.3
PyYAML 5.4.1
regex 2021.4.4
requests 2.25.1
retrying 1.3.3
s3transfer 0.3.6
scikit-learn 0.24.1
scipy 1.6.2
seaborn 0.11.1
setuptools 58.1.0
setuptools-git 1.2
simplejson 3.17.2
six 1.15.0
SQLAlchemy 1.4.5
stevedore 3.3.0
td-client 1.2.1
td-pyspark 21.3.0
td-pyspark-ea 20.12.0
threadpoolctl 2.1.0
toml 0.10.2
tqdm 4.60.0
urllib3 1.24.3
wcwidth 0.2.5
wheel 0.38.4