Skip to content

Currently, Treasure Workflow supports following Docker images:

  • treasuredata/customscript-python:3.12.11-td0 [current stable]
  • digdag/digdag-python:3.10.1 (3.10)
  • digdag/digdag-python:3.9.22-td1
  • digdag/digdag-python:3.9.2
  • digdag/digdag-python:3.9.1 (3.9)

Some images listed above still use the deprecated versioning scheme (such as 3.9, 3.9.1, 3.9.2) and contain security vulnerabilities. We recommend using images with the current versioning scheme (such as 3.9.22-td1) that include security fixes. For details about our versioning policy, please see Docker Image Versioning Scheme.

Note: Starting from Python 3.12, the image namespace has changed from digdag to treasuredata, and the image name has changed from digdag-python to customscript-python.

Installed python and library versions

The Python libraries installed in the Custom Script Docker image are divided into two groups: "required libraries" and "installed libraries".

“required libraries” are libraries listed in requirements.txt. They are installed as long as the Python minor version is the same. For example, the pystan library is in the "required libraries" of the 3.9.1 image, so you can expect 3.9.77-td88 image will contain the pystan library. However, 3.10.88-td99 image may not contain the pystan library.

On the other hand, “installed libraries” include dependencies of required libraries as well as required libraries. The libraries other than required libraries may not exist in the next version of the image.

Note: PySpark is no longer installed in Python 3.12+ images, unlike previous versions.

treasuredata/customscript-python:3.12.11-td0 [current stable]

  • Python 3.12.11
  • required libraries:
boto3
convertdate
Cython
holidays
hyperopt
lightgbm
lunarcalendar
matplotlib
memory_profiler
nltk
numpy
optuna
optuna-integration[sklearn]
pandas
plotly
prophet
pyarrow
pystan
pytd
pytest
requests
scikit-learn
scipy
seaborn
simplejson
tqdm
  • installed libraries:
Package               Version
--------------------- ----------
aiohappyeyeballs      2.6.1
aiohttp               3.12.15
aiosignal             1.4.0
alembic               1.16.4
appdirs               1.4.4
attrs                 25.3.0
boto3                 1.40.16
botocore              1.40.16
certifi               2025.8.3
charset-normalizer    3.4.3
click                 8.2.1
clikit                0.6.2
cloudpickle           3.1.1
cmdstanpy             1.2.5
colorlog              6.9.0
contourpy             1.3.3
convertdate           2.4.0
crashtest             0.3.1
cycler                0.12.1
Cython                3.1.3
ephem                 4.2
fonttools             4.59.1
frozenlist            1.7.0
future                1.0.0
greenlet              3.2.4
holidays              0.79
httpstan              4.13.0
hyperopt              0.2.7
idna                  3.10
importlib_resources   6.5.2
iniconfig             2.1.0
jmespath              1.0.1
joblib                1.5.1
kiwisolver            1.4.9
lightgbm              4.6.0
LunarCalendar         0.0.9
lz4                   4.4.4
Mako                  1.3.10
MarkupSafe            3.0.2
marshmallow           3.26.1
matplotlib            3.10.5
memory-profiler       0.61.0
msgpack               1.1.1
multidict             6.6.4
narwhals              2.2.0
networkx              3.5
nltk                  3.9.1
numpy                 2.3.2
optuna                4.5.0
optuna-integration    4.5.0
orjson                3.11.2
packaging             25.0
pandas                2.3.2
pastel                0.2.1
pillow                11.3.0
plotly                6.3.0
pluggy                1.6.0
propcache             0.3.2
prophet               1.1.7
psutil                7.0.0
py4j                  0.10.9.9
pyarrow               21.0.0
Pygments              2.19.2
pylev                 1.4.0
PyMeeus               0.5.12
pyparsing             3.2.3
pysimdjson            6.0.2
pystan                3.10.0
pytd                  2.2.0
pytest                8.4.1
python-dateutil       2.9.0.post0
pytz                  2025.2
PyYAML                6.0.2
regex                 2025.7.34
requests              2.32.5
s3transfer            0.13.1
scikit-learn          1.7.1
scipy                 1.16.1
seaborn               0.13.2
setuptools            80.9.0
simplejson            3.20.1
six                   1.17.0
SQLAlchemy            2.0.43
stanio                0.5.1
td-client             1.5.0
threadpoolctl         3.6.0
tqdm                  4.67.1
trino                 0.336.0
typing_extensions     4.14.1
tzdata                2025.2
tzlocal               5.3.1
urllib3               2.5.0
webargs               8.7.0
yarl                  1.20.1
zstandard             0.24.0

digdag/digdag-python:3.9.22-td1

  • Python 3.9.22
  • required libraries:
boto3
fbprophet
futures
hyperopt
lightgbm
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm
  • installed libraries:
Package               Version
--------------------- ---------
alembic               1.5.8
attrs                 20.3.0
boto3                 1.26.132
botocore              1.29.132
certifi               2025.4.26
chardet               4.0.0
click                 7.1.2
cliff                 3.5.0
cloudpickle           1.6.0
cmaes                 0.8.2
cmd2                  1.5.0
cmdstanpy             0.9.5
colorama              0.4.4
colorlog              4.8.0
convertdate           2.2.0
cycler                0.10.0
Cython                0.29.22
ephem                 3.7.7.1
fbprophet             0.7.1
future                0.18.3
futures               3.1.1
greenlet              1.0.0
holidays              0.10.4
hyperopt              0.2.5
idna                  2.10
iniconfig             1.1.1
jmespath              0.10.0
joblib                1.1.1
kiwisolver            1.3.1
korean-lunar-calendar 0.2.1
lightgbm              4.6.0
LunarCalendar         0.0.9
Mako                  1.1.4
MarkupSafe            1.1.1
matplotlib            3.4.1
memory-profiler       0.58.0
msgpack               1.0.2
networkx              2.6
nltk                  3.9.1
numpy                 1.20.2
optuna                2.7.0
packaging             20.9
pandas                1.3.0
pbr                   5.5.1
pillow                10.3.0
pip                   25.1.1
plotly                4.14.3
pluggy                0.13.1
presto-python-client  0.7.0
prettytable           0.7.2
psutil                5.8.0
py                    1.10.0
py4j                  0.10.9.7
pyarrow               14.0.1
PyMeeus               0.5.11
pyparsing             2.4.7
pyperclip             1.8.2
pyspark               3.5.5
pystan                2.19.1.1
pytd                  1.5.2
pytest                6.2.3
python-dateutil       2.8.1
python-editor         1.0.4
pytz                  2019.3
PyYAML                5.4.1
regex                 2021.8.3
requests              2.25.1
retrying              1.3.3
s3transfer            0.6.1
scikit-learn          0.24.1
scipy                 1.8.0
seaborn               0.11.1
setuptools            58.1.0
setuptools-git        1.2
simplejson            3.17.2
six                   1.15.0
SQLAlchemy            1.4.5
stevedore             3.3.0
td-client             1.2.1
td-pyspark            21.3.0
td-pyspark-ea         20.12.0
threadpoolctl         2.1.0
toml                  0.10.2
tqdm                  4.60.0
urllib3               1.26.0
wcwidth               0.2.5
wheel                 0.45.1

digdag/digdag-python:3.10.1 (3.10)

  • Python 3.10.11
  • required libraries:
boto3
convertdate
Cython
futures
holidays
hyperopt
lightgbm
lunarcalendar
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
prophet
pyarrow
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm
  • installed libraries:
Package               Version
--------------------- --------
aiohttp               3.8.4
aiosignal             1.3.1
alembic               1.10.4
appdirs               1.4.4
async-timeout         4.0.2
attrs                 23.1.0
boto3                 1.26.132
botocore              1.29.132
certifi               2023.5.7
charset-normalizer    3.1.0
click                 8.1.3
clikit                0.6.2
cloudpickle           2.2.1
cmaes                 0.9.1
cmdstanpy             1.1.0
colorlog              6.7.0
contourpy             1.0.7
convertdate           2.4.0
crashtest             0.3.1
cycler                0.11.0
Cython                0.29.34
ephem                 4.1.4
exceptiongroup        1.1.1
fonttools             4.39.4
frozenlist            1.3.3
future                0.18.3
futures               3.0.5
greenlet              2.0.2
hijri-converter       2.3.1
holidays              0.24
httpstan              4.10.0
hyperopt              0.2.7
idna                  3.4
iniconfig             2.0.0
jmespath              1.0.1
joblib                1.2.0
kiwisolver            1.4.4
korean-lunar-calendar 0.3.1
lightgbm              3.3.5
LunarCalendar         0.0.9
Mako                  1.2.4
MarkupSafe            2.1.2
marshmallow           3.19.0
matplotlib            3.7.1
memory-profiler       0.61.0
msgpack               1.0.5
multidict             6.0.4
networkx              3.1
nltk                  3.8.1
numpy                 1.23.5
optuna                3.1.1
packaging             23.1
pandas                1.5.3
pastel                0.2.1
Pillow                9.5.0
pip                   23.1.2
plotly                5.14.1
pluggy                1.0.0
presto-python-client  0.8.3
prophet               1.1.2
psutil                5.9.5
py4j                  0.10.9.7
pyarrow               12.0.0
pylev                 1.4.0
PyMeeus               0.5.12
pyparsing             3.0.9
pysimdjson            5.0.2
pyspark               3.4.0
pystan                3.7.0
pytd                  1.5.1
pytest                7.3.1
python-dateutil       2.8.2
pytz                  2023.3
PyYAML                6.0
regex                 2023.5.5
requests              2.30.0
s3transfer            0.6.1
scikit-learn          1.2.2
scipy                 1.10.1
seaborn               0.12.2
setuptools            65.5.1
simplejson            3.19.1
six                   1.16.0
SQLAlchemy            2.0.13
td-client             1.2.1
td-pyspark            22.7.1
td-pyspark-ea         20.12.0
tenacity              8.2.2
threadpoolctl         3.1.0
tomli                 2.0.1
tqdm                  4.65.0
typing_extensions     4.5.0
urllib3               1.26.15
webargs               8.2.0
wheel                 0.38.4
yarl                  1.9.2

digdag/digdag-python:3.9.2

  • Python 3.9.16
  • required libraries:
boto3
fbprophet
futures
hyperopt
lightgbm
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm
  • installed libraries:
Package               Version
--------------------- ---------
alembic               1.5.8
attrs                 20.3.0
boto3                 1.26.132
botocore              1.29.132
certifi               2020.12.5
chardet               4.0.0
click                 7.1.2
cliff                 3.5.0
cloudpickle           1.6.0
cmaes                 0.8.2
cmd2                  1.5.0
cmdstanpy             0.9.5
colorama              0.4.4
colorlog              4.8.0
convertdate           2.2.0
cycler                0.10.0
Cython                0.29.22
ephem                 3.7.7.1
fbprophet             0.7.1
future                0.18.3
futures               3.1.1
greenlet              1.0.0
holidays              0.10.4
hyperopt              0.2.5
idna                  2.10
iniconfig             1.1.1
jmespath              0.10.0
joblib                1.1.1
kiwisolver            1.3.1
korean-lunar-calendar 0.2.1
lightgbm              3.2.0
LunarCalendar         0.0.9
Mako                  1.1.4
MarkupSafe            1.1.1
matplotlib            3.4.1
memory-profiler       0.58.0
msgpack               1.0.2
networkx              2.6
nltk                  3.6.6
numpy                 1.20.2
optuna                2.7.0
packaging             20.9
pandas                1.3.0
pbr                   5.5.1
Pillow                9.0.0
pip                   23.1.2
plotly                4.14.3
pluggy                0.13.1
presto-python-client  0.7.0
prettytable           0.7.2
psutil                5.8.0
py                    1.10.0
py4j                  0.10.9.7
pyarrow               12.0.0
PyMeeus               0.5.11
pyparsing             2.4.7
pyperclip             1.8.2
pyspark               3.4.0
pystan                2.19.1.1
pytd                  1.5.1
pytest                6.2.3
python-dateutil       2.8.1
python-editor         1.0.4
pytz                  2019.3
PyYAML                5.4.1
regex                 2021.8.3
requests              2.25.1
retrying              1.3.3
s3transfer            0.6.1
scikit-learn          0.24.1
scipy                 1.6.2
seaborn               0.11.1
setuptools            58.1.0
setuptools-git        1.2
simplejson            3.17.2
six                   1.15.0
SQLAlchemy            1.4.5
stevedore             3.3.0
td-client             1.2.1
td-pyspark            21.3.0
td-pyspark-ea         20.12.0
threadpoolctl         2.1.0
toml                  0.10.2
tqdm                  4.60.0
urllib3               1.26.0
wcwidth               0.2.5
wheel                 0.40.0

digdag/digdag-python:3.9.1 (3.9)

  • Python 3.9.15
  • required libraries:
boto3
fbprophet
futures
hyperopt
lightgbm
matplotlib
memory_profiler
nltk
numpy
optuna
pandas
plotly
pystan
pytd[spark]
pytest
requests
scikit-learn
scipy
seaborn
simplejson
td-pyspark-ea
tqdm
  • installed libraries:
Package               Version
--------------------- ---------
alembic               1.5.8
attrs                 20.3.0
boto3                 1.15.18
botocore              1.18.18
certifi               2020.12.5
chardet               4.0.0
click                 7.1.2
cliff                 3.5.0
cloudpickle           1.6.0
cmaes                 0.8.2
cmd2                  1.5.0
cmdstanpy             0.9.5
colorama              0.4.4
colorlog              4.8.0
convertdate           2.2.0
cycler                0.10.0
Cython                0.29.22
decorator             4.4.2
ephem                 3.7.7.1
fbprophet             0.7.1
future                0.18.2
futures               3.1.1
greenlet              1.0.0
holidays              0.10.4
hyperopt              0.2.5
idna                  2.10
iniconfig             1.1.1
jmespath              0.10.0
joblib                1.0.1
kiwisolver            1.3.1
korean-lunar-calendar 0.2.1
lightgbm              3.2.0
LunarCalendar         0.0.9
Mako                  1.1.4
MarkupSafe            1.1.1
matplotlib            3.4.1
memory-profiler       0.58.0
msgpack               1.0.2
networkx              2.5.1
nltk                  3.5
numpy                 1.20.2
optuna                2.7.0
packaging             20.9
pandas                1.2.3
pbr                   5.5.1
Pillow                8.2.0
pip                   22.3.1
plotly                4.14.3
pluggy                0.13.1
presto-python-client  0.7.0
prettytable           0.7.2
psutil                5.8.0
py                    1.10.0
py4j                  0.10.9
pyarrow               3.0.0
PyMeeus               0.5.11
pyparsing             2.4.7
pyperclip             1.8.2
pyspark               3.1.1
pystan                2.19.1.1
pytd                  1.4.0
pytest                6.2.3
python-dateutil       2.8.1
python-editor         1.0.4
pytz                  2019.3
PyYAML                5.4.1
regex                 2021.4.4
requests              2.25.1
retrying              1.3.3
s3transfer            0.3.6
scikit-learn          0.24.1
scipy                 1.6.2
seaborn               0.11.1
setuptools            58.1.0
setuptools-git        1.2
simplejson            3.17.2
six                   1.15.0
SQLAlchemy            1.4.5
stevedore             3.3.0
td-client             1.2.1
td-pyspark            21.3.0
td-pyspark-ea         20.12.0
threadpoolctl         2.1.0
toml                  0.10.2
tqdm                  4.60.0
urllib3               1.24.3
wcwidth               0.2.5
wheel                 0.38.4