Currently, Treasure Workflow supports following Docker images:
- treasuredata/customscript-python:3.12.11-td0 [current stable]
- digdag/digdag-python:3.10.1 (3.10)
- digdag/digdag-python:3.9.22-td1
- digdag/digdag-python:3.9.2
- digdag/digdag-python:3.9.1 (3.9)
Some images listed above still use the deprecated versioning scheme (such as 3.9, 3.9.1, 3.9.2) and contain security vulnerabilities. We recommend using images with the current versioning scheme (such as 3.9.22-td1) that include security fixes. For details about our versioning policy, please see Docker Image Versioning Scheme.
Note: Starting from Python 3.12, the image namespace has changed from digdag
to treasuredata
, and the image name has changed from digdag-python
to customscript-python
.
The Python libraries installed in the Custom Script Docker image are divided into two groups: "required libraries" and "installed libraries".
“required libraries” are libraries listed in requirements.txt. They are installed as long as the Python minor version is the same. For example, the pystan
library is in the "required libraries" of the 3.9.1 image, so you can expect 3.9.77-td88 image will contain the pystan
library. However, 3.10.88-td99 image may not contain the pystan
library.
On the other hand, “installed libraries” include dependencies of required libraries as well as required libraries. The libraries other than required libraries may not exist in the next version of the image.
Note: PySpark is no longer installed in Python 3.12+ images, unlike previous versions.
- Python 3.12.11
- required libraries:
boto3
convertdate
Cython
holidays
hyperopt
lightgbm
lunarcalendar
matplotlib
memory_profiler
nltk
numpy
optuna
optuna-integration[sklearn]
pandas
plotly
prophet
pyarrow
pystan
pytd
pytest
requests
scikit-learn
scipy
seaborn
simplejson
tqdm
- installed libraries:
Package Version
--------------------- ----------
aiohappyeyeballs 2.6.1
aiohttp 3.12.15
aiosignal 1.4.0
alembic 1.16.4
appdirs 1.4.4
attrs 25.3.0
boto3 1.40.16
botocore 1.40.16
certifi 2025.8.3
charset-normalizer 3.4.3
click 8.2.1
clikit 0.6.2
cloudpickle 3.1.1
cmdstanpy 1.2.5
colorlog 6.9.0
contourpy 1.3.3
convertdate 2.4.0
crashtest 0.3.1
cycler 0.12.1
Cython 3.1.3
ephem 4.2
fonttools 4.59.1
frozenlist 1.7.0
future 1.0.0
greenlet 3.2.4
holidays 0.79
httpstan 4.13.0
hyperopt 0.2.7
idna 3.10
importlib_resources 6.5.2
iniconfig 2.1.0
jmespath 1.0.1
joblib 1.5.1
kiwisolver 1.4.9
lightgbm 4.6.0
LunarCalendar 0.0.9
lz4 4.4.4
Mako 1.3.10
MarkupSafe 3.0.2
marshmallow 3.26.1
matplotlib 3.10.5
memory-profiler 0.61.0
msgpack 1.1.1
multidict 6.6.4
narwhals 2.2.0
networkx 3.5
nltk 3.9.1
numpy 2.3.2
optuna 4.5.0
optuna-integration 4.5.0
orjson 3.11.2
packaging 25.0
pandas 2.3.2
pastel 0.2.1
pillow 11.3.0
plotly 6.3.0
pluggy 1.6.0
propcache 0.3.2
prophet 1.1.7
psutil 7.0.0
py4j 0.10.9.9
pyarrow 21.0.0
Pygments 2.19.2
pylev 1.4.0
PyMeeus 0.5.12
pyparsing 3.2.3
pysimdjson 6.0.2
pystan 3.10.0
pytd 2.2.0
pytest 8.4.1
python-dateutil 2.9.0.post0
pytz 2025.2
PyYAML 6.0.2
regex 2025.7.34
requests 2.32.5
s3transfer 0.13.1
scikit-learn 1.7.1
scipy 1.16.1
seaborn 0.13.2
setuptools 80.9.0
simplejson 3.20.1
six 1.17.0
SQLAlchemy 2.0.43
stanio 0.5.1
td-client 1.5.0
threadpoolctl 3.6.0
tqdm 4.67.1
trino 0.336.0
typing_extensions 4.14.1
tzdata 2025.2
tzlocal 5.3.1
urllib3 2.5.0
webargs 8.7.0
yarl 1.20.1
zstandard 0.24.0
- Python 3.9.22
- required libraries:
boto3
fbprophet
futures
hyperopt
lightgbm
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm
- installed libraries:
Package Version
--------------------- ---------
alembic 1.5.8
attrs 20.3.0
boto3 1.26.132
botocore 1.29.132
certifi 2025.4.26
chardet 4.0.0
click 7.1.2
cliff 3.5.0
cloudpickle 1.6.0
cmaes 0.8.2
cmd2 1.5.0
cmdstanpy 0.9.5
colorama 0.4.4
colorlog 4.8.0
convertdate 2.2.0
cycler 0.10.0
Cython 0.29.22
ephem 3.7.7.1
fbprophet 0.7.1
future 0.18.3
futures 3.1.1
greenlet 1.0.0
holidays 0.10.4
hyperopt 0.2.5
idna 2.10
iniconfig 1.1.1
jmespath 0.10.0
joblib 1.1.1
kiwisolver 1.3.1
korean-lunar-calendar 0.2.1
lightgbm 4.6.0
LunarCalendar 0.0.9
Mako 1.1.4
MarkupSafe 1.1.1
matplotlib 3.4.1
memory-profiler 0.58.0
msgpack 1.0.2
networkx 2.6
nltk 3.9.1
numpy 1.20.2
optuna 2.7.0
packaging 20.9
pandas 1.3.0
pbr 5.5.1
pillow 10.3.0
pip 25.1.1
plotly 4.14.3
pluggy 0.13.1
presto-python-client 0.7.0
prettytable 0.7.2
psutil 5.8.0
py 1.10.0
py4j 0.10.9.7
pyarrow 14.0.1
PyMeeus 0.5.11
pyparsing 2.4.7
pyperclip 1.8.2
pyspark 3.5.5
pystan 2.19.1.1
pytd 1.5.2
pytest 6.2.3
python-dateutil 2.8.1
python-editor 1.0.4
pytz 2019.3
PyYAML 5.4.1
regex 2021.8.3
requests 2.25.1
retrying 1.3.3
s3transfer 0.6.1
scikit-learn 0.24.1
scipy 1.8.0
seaborn 0.11.1
setuptools 58.1.0
setuptools-git 1.2
simplejson 3.17.2
six 1.15.0
SQLAlchemy 1.4.5
stevedore 3.3.0
td-client 1.2.1
td-pyspark 21.3.0
td-pyspark-ea 20.12.0
threadpoolctl 2.1.0
toml 0.10.2
tqdm 4.60.0
urllib3 1.26.0
wcwidth 0.2.5
wheel 0.45.1
- Python 3.10.11
- required libraries:
boto3
convertdate
Cython
futures
holidays
hyperopt
lightgbm
lunarcalendar
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
prophet
pyarrow
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm
- installed libraries:
Package Version
--------------------- --------
aiohttp 3.8.4
aiosignal 1.3.1
alembic 1.10.4
appdirs 1.4.4
async-timeout 4.0.2
attrs 23.1.0
boto3 1.26.132
botocore 1.29.132
certifi 2023.5.7
charset-normalizer 3.1.0
click 8.1.3
clikit 0.6.2
cloudpickle 2.2.1
cmaes 0.9.1
cmdstanpy 1.1.0
colorlog 6.7.0
contourpy 1.0.7
convertdate 2.4.0
crashtest 0.3.1
cycler 0.11.0
Cython 0.29.34
ephem 4.1.4
exceptiongroup 1.1.1
fonttools 4.39.4
frozenlist 1.3.3
future 0.18.3
futures 3.0.5
greenlet 2.0.2
hijri-converter 2.3.1
holidays 0.24
httpstan 4.10.0
hyperopt 0.2.7
idna 3.4
iniconfig 2.0.0
jmespath 1.0.1
joblib 1.2.0
kiwisolver 1.4.4
korean-lunar-calendar 0.3.1
lightgbm 3.3.5
LunarCalendar 0.0.9
Mako 1.2.4
MarkupSafe 2.1.2
marshmallow 3.19.0
matplotlib 3.7.1
memory-profiler 0.61.0
msgpack 1.0.5
multidict 6.0.4
networkx 3.1
nltk 3.8.1
numpy 1.23.5
optuna 3.1.1
packaging 23.1
pandas 1.5.3
pastel 0.2.1
Pillow 9.5.0
pip 23.1.2
plotly 5.14.1
pluggy 1.0.0
presto-python-client 0.8.3
prophet 1.1.2
psutil 5.9.5
py4j 0.10.9.7
pyarrow 12.0.0
pylev 1.4.0
PyMeeus 0.5.12
pyparsing 3.0.9
pysimdjson 5.0.2
pyspark 3.4.0
pystan 3.7.0
pytd 1.5.1
pytest 7.3.1
python-dateutil 2.8.2
pytz 2023.3
PyYAML 6.0
regex 2023.5.5
requests 2.30.0
s3transfer 0.6.1
scikit-learn 1.2.2
scipy 1.10.1
seaborn 0.12.2
setuptools 65.5.1
simplejson 3.19.1
six 1.16.0
SQLAlchemy 2.0.13
td-client 1.2.1
td-pyspark 22.7.1
td-pyspark-ea 20.12.0
tenacity 8.2.2
threadpoolctl 3.1.0
tomli 2.0.1
tqdm 4.65.0
typing_extensions 4.5.0
urllib3 1.26.15
webargs 8.2.0
wheel 0.38.4
yarl 1.9.2
- Python 3.9.16
- required libraries:
boto3
fbprophet
futures
hyperopt
lightgbm
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm
- installed libraries:
Package Version
--------------------- ---------
alembic 1.5.8
attrs 20.3.0
boto3 1.26.132
botocore 1.29.132
certifi 2020.12.5
chardet 4.0.0
click 7.1.2
cliff 3.5.0
cloudpickle 1.6.0
cmaes 0.8.2
cmd2 1.5.0
cmdstanpy 0.9.5
colorama 0.4.4
colorlog 4.8.0
convertdate 2.2.0
cycler 0.10.0
Cython 0.29.22
ephem 3.7.7.1
fbprophet 0.7.1
future 0.18.3
futures 3.1.1
greenlet 1.0.0
holidays 0.10.4
hyperopt 0.2.5
idna 2.10
iniconfig 1.1.1
jmespath 0.10.0
joblib 1.1.1
kiwisolver 1.3.1
korean-lunar-calendar 0.2.1
lightgbm 3.2.0
LunarCalendar 0.0.9
Mako 1.1.4
MarkupSafe 1.1.1
matplotlib 3.4.1
memory-profiler 0.58.0
msgpack 1.0.2
networkx 2.6
nltk 3.6.6
numpy 1.20.2
optuna 2.7.0
packaging 20.9
pandas 1.3.0
pbr 5.5.1
Pillow 9.0.0
pip 23.1.2
plotly 4.14.3
pluggy 0.13.1
presto-python-client 0.7.0
prettytable 0.7.2
psutil 5.8.0
py 1.10.0
py4j 0.10.9.7
pyarrow 12.0.0
PyMeeus 0.5.11
pyparsing 2.4.7
pyperclip 1.8.2
pyspark 3.4.0
pystan 2.19.1.1
pytd 1.5.1
pytest 6.2.3
python-dateutil 2.8.1
python-editor 1.0.4
pytz 2019.3
PyYAML 5.4.1
regex 2021.8.3
requests 2.25.1
retrying 1.3.3
s3transfer 0.6.1
scikit-learn 0.24.1
scipy 1.6.2
seaborn 0.11.1
setuptools 58.1.0
setuptools-git 1.2
simplejson 3.17.2
six 1.15.0
SQLAlchemy 1.4.5
stevedore 3.3.0
td-client 1.2.1
td-pyspark 21.3.0
td-pyspark-ea 20.12.0
threadpoolctl 2.1.0
toml 0.10.2
tqdm 4.60.0
urllib3 1.26.0
wcwidth 0.2.5
wheel 0.40.0
- Python 3.9.15
- required libraries:
boto3
fbprophet
futures
hyperopt
lightgbm
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm
- installed libraries:
Package Version
--------------------- ---------
alembic 1.5.8
attrs 20.3.0
boto3 1.15.18
botocore 1.18.18
certifi 2020.12.5
chardet 4.0.0
click 7.1.2
cliff 3.5.0
cloudpickle 1.6.0
cmaes 0.8.2
cmd2 1.5.0
cmdstanpy 0.9.5
colorama 0.4.4
colorlog 4.8.0
convertdate 2.2.0
cycler 0.10.0
Cython 0.29.22
decorator 4.4.2
ephem 3.7.7.1
fbprophet 0.7.1
future 0.18.2
futures 3.1.1
greenlet 1.0.0
holidays 0.10.4
hyperopt 0.2.5
idna 2.10
iniconfig 1.1.1
jmespath 0.10.0
joblib 1.0.1
kiwisolver 1.3.1
korean-lunar-calendar 0.2.1
lightgbm 3.2.0
LunarCalendar 0.0.9
Mako 1.1.4
MarkupSafe 1.1.1
matplotlib 3.4.1
memory-profiler 0.58.0
msgpack 1.0.2
networkx 2.5.1
nltk 3.5
numpy 1.20.2
optuna 2.7.0
packaging 20.9
pandas 1.2.3
pbr 5.5.1
Pillow 8.2.0
pip 22.3.1
plotly 4.14.3
pluggy 0.13.1
presto-python-client 0.7.0
prettytable 0.7.2
psutil 5.8.0
py 1.10.0
py4j 0.10.9
pyarrow 3.0.0
PyMeeus 0.5.11
pyparsing 2.4.7
pyperclip 1.8.2
pyspark 3.1.1
pystan 2.19.1.1
pytd 1.4.0
pytest 6.2.3
python-dateutil 2.8.1
python-editor 1.0.4
pytz 2019.3
PyYAML 5.4.1
regex 2021.4.4
requests 2.25.1
retrying 1.3.3
s3transfer 0.3.6
scikit-learn 0.24.1
scipy 1.6.2
seaborn 0.11.1
setuptools 58.1.0
setuptools-git 1.2
simplejson 3.17.2
six 1.15.0
SQLAlchemy 1.4.5
stevedore 3.3.0
td-client 1.2.1
td-pyspark 21.3.0
td-pyspark-ea 20.12.0
threadpoolctl 2.1.0
toml 0.10.2
tqdm 4.60.0
urllib3 1.24.3
wcwidth 0.2.5
wheel 0.38.4