AWS SDK for pandas 3.17.1

Bugfixes 🐛

• fix: map Athena varbinary correctly in athena2pyarrow by @hsusul in #3413
• fix: ignore double colon cast operators in SQL parameter substitution by @hsusul in #3414
• fix: handle zero max_items_evaluated in DynamoDB read_items by @hsusul in #3417
• fix(athena): properly escape identifiers in Iceberg SQL generation by @kukushking in #3423

Security / Dependency Updates 🛡️

• chore(deps-dev): bump ruff from 0.15.18 to 0.15.20 in the development-dependencies group by @dependabot[bot] in #3392
• chore(deps): bump the production-dependencies group with 3 updates by @dependabot[bot] in #3391
• chore(deps): bump actions/cache from 5 to 6 in the github-actions group by @dependabot[bot] in #3390
• chore(deps): bump the production-dependencies group across 1 directory with 5 updates by @dependabot[bot] in #3401
• chore(deps): bump mistune from 3.2.1 to 3.3.0 by @dependabot[bot] in #3400
• chore(deps): bump soupsieve from 2.8.3 to 2.8.4 by @dependabot[bot] in #3399
• fix(lambda): use PyPI wheels for numpy/pandas on AL2023 layer builds … by @kukushking in #3398
• chore(deps-dev): bump the development-dependencies group across 1 directory with 5 updates by @dependabot[bot] in #3402
• chore(deps): bump the production-dependencies group with 2 updates by @dependabot[bot] in #3405
• chore(deps): bump actions/setup-node from 6 to 7 in the github-actions group by @dependabot[bot] in #3404
• chore(deps): bump pyasn1 from 0.6.3 to 0.6.4 by @dependabot[bot] in #3408
• chore(deps): bump the production-dependencies group with 3 updates by @dependabot[bot] in #3416
• chore(deps): bump ray from 2.55.1 to 2.56.0 by @dependabot[bot] in #3420

Housekeeping 🧹

• chore: Release 3.17.1 by @kukushking in #3403

New Contributors

• @hsusul made their first contribution in #3413

Full Changelog: 3.17.0...3.17.1

AWS SDK for pandas 3.17.0

Notable Changes ⚠️

• chore(lambda-layer): bump pyarrow to 24.0.0 by @PatrickBunker in #3375

Features / Enhancements 🚀

• feat: Support S3 Vectors by @kukushking in #3330
• feat(data-types): Support PyArrow ExtensionTypes in pyarrow2athena by @richacode007-byte in #3351
• feat(dynamodb): add key_schema parameter to read_items to bypass Desc… by @jagannalla in #3352

Bugfixes 🐛

• fix: preserve column names with spaces in wr.redshift.copy() by @hirenkumar-n-dholariya in #3298
• fix: reduce Lambda layer size by building Arrow without ICU by @bujjibabukatta in #3336
• fix(neptune): validate IRI cell values in to_rdf_graph by @kukushking in #3369
• fix(athena): escape single quotes in iceberg DDL splices by @kukushking in #3372

Security / Dependency Updates 🛡️

• chore(deps): bump redshift-connector from 2.1.13 to 2.1.14 by @dependabot[bot] in #3349
• chore(deps): bump the production-dependencies group across 1 directory with 11 updates by @dependabot[bot] in #3339
• chore(deps): bump aiohttp from 3.13.5 to 3.14.0 by @dependabot[bot] in #3353
• chore(deps): bump urllib3 from 2.6.3 to 2.7.0 by @dependabot[bot] in #3332
• chore(deps): bump mistune from 3.2.0 to 3.2.1 by @dependabot[bot] in #3327
• chore(deps): bump idna from 3.11 to 3.15 by @dependabot[bot] in #3337
• chore(deps): bump uv from 0.11.6 to 0.11.15 by @dependabot[bot] in #3348
• chore(deps): bump jupyter-server from 2.17.0 to 2.18.0 by @dependabot[bot] in #3354
• chore(deps): bump async-timeout from 4.0.3 to 5.0.1 in the production-dependencies group by @dependabot[bot] in #3356
• chore(deps-dev): bump the development-dependencies group across 1 directory with 15 updates by @dependabot[bot] in #3355
• chore(deps): bump tornado from 6.5.5 to 6.5.6 by @dependabot[bot] in #3365
• chore(deps-dev): bump the development-dependencies group across 1 directory with 4 updates by @dependabot[bot] in #3368
• chore(deps): bump gremlinpython to 3.8 by @kukushking in #3370
• chore(deps): bump aiohttp from 3.14.0 to 3.14.1 by @dependabot[bot] in #3373
• chore(deps): bump cryptography from 46.0.7 to 48.0.1 by @dependabot[bot] in #3378
• chore(deps): bump bleach from 6.3.0 to 6.4.0 by @dependabot[bot] in #3377
• chore(deps): bump the production-dependencies group across 1 directory with 3 updates by @dependabot[bot] in #3379
• chore(deps): bump tornado from 6.5.6 to 6.5.7 by @dependabot[bot] in #3376
• chore(deps): bump jupyter-server from 2.18.0 to 2.20.0 by @dependabot[bot] in #3384
• chore(deps): bump actions/checkout from 6 to 7 in the github-actions group by @dependabot[bot] in #3381
• chore(deps): bump the production-dependencies group across 1 directory with 2 updates by @dependabot[bot] in #3382
• chore(deps-dev): bump the development-dependencies group with 6 updates by @dependabot[bot] in #3383
• chore(deps-dev): bump msgpack from 1.2.0 to 1.2.1 by @dependabot[bot] in #3385
• chore(deps): bump pydantic-settings from 2.13.1 to 2.14.2 by @dependabot[bot] in #3386

Housekeeping 🧹

• chore: Release 3.17.0 by @kukushking in #3371

New Contributors

• @richacode007-byte made their first contribution in #3351
• @bujjibabukatta made their first contribution in #3336
• @jagannalla made their first contribution in #3352
• @hirenkumar-n-dholariya made their first contribution in #3298
• @PatrickBunker made their first contribution in #3375

Full Changelog: 3.16.1...3.17.0

AWS SDK for pandas 3.16.1

Notable Changes ⚠️

• pyarrow upgraded from v20.0.0 to v.22.0.0 in AWS lambda layers ⚠️
• AWS Lambda layer region expansion: added layers in ca-west-1 Canada West (Calgary) 🇨🇦

Bugfixes 🐛

• fix(athena): verify bucket ownership and manifest integrity by @kukushking in #3314

Security / Dependency Updates 🛡️

• chore(deps): bump cryptography from 46.0.6 to 46.0.7 by @dependabot[bot] in #3297
• chore(deps): bump uv from 0.10.10 to 0.11.6 by @dependabot[bot] in #3299
• chore(deps-dev): bump pytest from 8.4.2 to 9.0.3 by @dependabot[bot] in #3303
• fix(deps): upgrade lxml to 6.1.0 and redshift-connector to 2.1.13 (CVE-2026-41066) by @kukushking in #3309
• fix(deps): bump ray, jupyterlab, nbconvert, pip due to CVEs by @kukushking in #3316
• chore(deps): bump the github-actions group across 1 directory with 2 updates by @dependabot[bot] in #3300
• chore: Release 3.16.1 by @kukushking in #3318
• chore(deps): bump jupyter-server from 2.17.0 to 2.18.0 by @dependabot[bot] in #3321
• chore(deps-dev): bump the development-dependencies group across 1 directory with 11 updates by @dependabot[bot] in #3323
• chore(deps): allow pyarrow 24 by @kukushking in #3325

Housekeeping 🧹

• chore: Update layers.rst by @kukushking in #3296

Full Changelog: 3.16.0...3.16.1

AWS SDK for pandas 3.16.0

Notable Changes ⚠️

• feat: Support Pandas 3.x by @kukushking in #3272

Features / Enhancements 🚀

• feat: Support S3 Tables by @kukushking in #3273

Bugfixes 🐛

• fix: Sanitize SQL construction in Redshift module by @kukushking in #3281
• fix: resolve Dependabot LICENSE.txt parse error by @jaidisido in #3286
• fix(iceberg): too many open partitions by sorting inserts by @knQzx in #3294
• fix: Support Athena workgroups with managed query results (#3174) by @Will282 in #3275
• fix: Bundle libxslt/libexslt shared libraries in Lambda layer by @kukushking in #3295

Security / Dependency Updates 🛡️

• chore(deps): bump aiohttp from 3.13.3 to 3.13.4 by @dependabot[bot] in #3292
• chore(deps): bump pyasn1 from 0.6.2 to 0.6.3 by @dependabot[bot] in #3289
• chore(deps): bump requests from 2.32.5 to 2.33.0 by @dependabot[bot] in #3288
• chore(deps): bump pygments from 2.19.2 to 2.20.0 by @dependabot[bot] in #3287
• chore(deps): bump cryptography from 46.0.5 to 46.0.6 by @dependabot[bot] in #3290

Housekeeping 🧹

• chore: Release 3.16.0 by @kukushking in #3285
• chore: Update layers.rst by @kukushking in #3269

New Contributors

• @knQzx made their first contribution in #3294
• @Will282 made their first contribution in #3275

Full Changelog: 3.15.1...3.16.0

AWS SDK for pandas 3.15.1

Security / Dependency Updates 🛡️

• fix: upgrade setuptools due to CVE-2026-23949 by @kukushking in #3261
• chore: pyasn1, wheel, filelock security fixes by @kukushking in #3262
• chore: wheel security fix #3262 by @kukushking in #3263
• chore: Update dependencies by @kukushking in #3268

Housekeeping 🧹

• chore(deps): bump virtualenv from 20.36.0 to 20.36.1 by @dependabot[bot] in #3256
• chore: Release 3.15.1 by @kukushking in #3264
• fix: Mark flaky throttled tests for rerun by @kukushking in #3266

Full Changelog: 3.15.0...3.15.1

AWS SDK for pandas 3.15.0

Notable Changes ⚠️

• fix: upgrade aiohttp due to CVE-2025-69223 by @kukushking in #3250
• chore: Build Python 3.14 layers by @kukushking in #3251
• chore: Drop Python 3.9 by @kukushking in #3257

Features / Enhancements 🚀

• feat(s3): add to_deltalake_streaming for single-commit Delta writes by @skoschik in #3231
• feat: Support Ray 2.53.0 by @kukushking in #3254

Bugfixes 🐛

• fix: handled the null values in the dataframe for existing open issue-2690 by @Kukreti12 in #3244

Security / Dependency Updates 🛡️

• chore: Update pyarrow constraints by @kukushking in #3236

Housekeeping 🧹

• chore: Update Snyk action by @kukushking in #3228
• chore: fix incorrect license field by @kukushking in #3229
• chore: Update layers.rst by @kukushking in #3230
• chore: add PyPI publish workflow by @kukushking in #3216
• chore(deps): bump the github-actions group with 2 updates by @dependabot[bot] in #3238
• chore: update cleanrooms analytics engine by @kukushking in #3239
• chore(deps): bump actions/checkout from 5 to 6 in the github-actions group by @dependabot[bot] in #3241
• fix: compatibility notice for sagemaker notebook al2-v3 by @ericfzhu in #3243
• chore(deps): bump the github-actions group with 2 updates by @dependabot[bot] in #3247
• chore(docs): Improve athena.to_iceberg documentation by @villoro in #3246
• chore: Update workflows by @kukushking in #3253
• chore: Prepare release 3.15.0 by @kukushking in #3252

New Contributors

• @ericfzhu made their first contribution in #3243
• @Kukreti12 made their first contribution in #3244
• @villoro made their first contribution in #3246

Full Changelog: 3.14.0...3.15.0

AWS SDK for pandas 3.14.0

Notable Changes ⚠️

• chore: upgrade pg8000 due to CVE-2025-61385 by @kukushking in #3225

Features / Enhancements 🚀

• feat: support redshift CLEANPATH by @kukushking in #3211
• feat: add result reuse configuration to query execution functions by @DavidKatz-il in #3212

Bugfixes 🐛

• fix: Add s3_output parameter to _start_query_execution call in "overwrite" mode by @sergeymazin in #3205
• fix: iceberg overwrite partitions with s3 output by @kukushking in #3220
• fix: Correct MemoryFormat.set() Parameter Type Annotation by @DaltonWorsnup in #3221
• fix: normalize AWS_SESSION_TOKEN=None to empty string for delta-rs compatibility by @skoschik in #3223

Security / Dependency Updates 🛡️

• chore(deps): bump the github-actions group with 2 updates by @dependabot[bot] in #3208
• chore: update pyarrow constraints by @kukushking in #3210
• chore(deps): bump the production-dependencies group across 1 directory with 4 updates by @dependabot[bot] in #3213
• chore(deps): bump actions/setup-node from 5 to 6 in the github-actions group by @dependabot[bot] in #3214

Housekeeping 🧹

• chore: replace deprecated pr linting action by @kukushking in #3215
• chore: Release 3.14.0 by @kukushking in #3227
• chore: Update Snyk action by @kukushking in #3228
• chore: fix incorrect license field by @kukushking in #3229
• chore: Update layers.rst by @kukushking in #3230

New Contributors

• @sergeymazin made their first contribution in #3205
• @DaltonWorsnup made their first contribution in #3221
• @skoschik made their first contribution in #3223

Full Changelog: 3.13.0...3.14.0

AWS SDK for pandas 3.13.0

Notable Changes ⚠️

• updated aiohhtp==3.12.15to fix CVE-2025-53643 (LOW) by @kukushking in #3197

Features / Enhancements 🚀

• feat: ray 2.49.0 by @kukushking in #3194
• feat: add support for aurora-mysql and aurora-postgresql engines by @senorcinco in #3188

Bugfixes 🐛

• fix: opensearch session by @kukushking in #3170
• fix: typo with Redshift write example by @Falydoor in #3184
• fix: do not remove new columns values by @Braalfa in #3181

Security / Dependency Updates 🛡️

• chore(deps): bump the production-dependencies group across 1 directory with 3 updates by @dependabot[bot] in #3178
• chore(deps): bump the production-dependencies group with 2 updates by @dependabot[bot] in #3180
• chore(deps): bump actions/checkout from 4 to 5 in the github-actions group by @dependabot[bot] in #3186
• chore(deps): bump the github-actions group with 3 updates by @dependabot[bot] in #3196
• chore(deps): update pytest-cov requirement from ~=6.0 to >=6,<8 in the production-dependencies group across 1 directory by @dependabot[bot] in #3198

Housekeeping 🧹

• chore: clean up poetry.lock by @kukushking in #3171

New Contributors

• @senorcinco made their first contribution in #3188
• @Braalfa made their first contribution in #3181

Full Changelog: 3.12.1...3.13.0

AWS SDK for pandas 3.12.1

Notable Changes ⚠️

• Moved to uv package manager 🔥 🔥 🔥

Features / Enhancements 🚀

• feat: uv by @kukushking in #3132

Security / Dependency Updates 🛡️

• chore(deps): bump the production-dependencies group with 4 updates by @dependabot in #3159
• chore(deps): bump the production-dependencies group with 4 updates by @dependabot in #3162
• chore(deps): bump requests from 2.32.3 to 2.32.4 by @dependabot in #3163
• chore(deps-dev): bump the development-dependencies group across 1 directory with 5 updates by @dependabot in #3161
• chore(deps): bump astral-sh/setup-uv from 5 to 6 in the github-actions group by @dependabot in #3164

Documentation / Workflows 📚

• chore: Release 3.12.1 by @EthanBunce in #3167

Full Changelog: 3.12.0...3.12.1

AWS SDK for pandas 3.12.0

Notable Changes ⚠️

• AWS Lambda Layers: pyarrow was upgraded to 20.0.0

Features / Enhancements 🚀

• feat: add pyarrow_additional_kwargs to athena.to_iceberg by @jaidisido in #3094
• feat: add dtype argument to delete_from_iceberg by @jaidisido in #3099
• feat: add redshift and rds data api query params by @kukushking in #3111
• chore: ray 2.45 by @kukushking in #3143
• chore: upgrade setuptools & pin cmake by @kukushking in #3152
• chore: update pyarrow version by @EthanBunce in #3156

Bugfixes 🐛

• fix: Supports pyarrow's large_list by @ashrielbrian in #3086
• fix: large_list and large_string unit test for read_parquet_metadata by @ashrielbrian in #3089
• fix: handle partitions with empty table in read_parquet with dataset=True by @cournape in #2983
• fix: oracle decimal error by @kukushking in #3103
• chore: add redshift COPY with SERIALIZETOJSON test case by @kukushking in #3104
• fix: Changing dtype lowercasing to start of athena2pyarrow function by @DanielMy777 in #3122
• fix: concat with union categories by @kukushking in #3127
• fix: upgrade CDK RDS serverless databases to V2 by @jaidisido in #3128
• fix(athena): ensure thread safety when reading local Athena cache by @david-mateo in #3137

Security / Dependency Updates 🛡️

• chore(deps): bump the production-dependencies group with 2 updates by @dependabot in #3071
• chore(deps-dev): bump the development-dependencies group with 3 updates by @dependabot in #3072
• chore(deps): bump the production-dependencies group with 3 updates by @dependabot in #3075
• chore(deps-dev): bump the development-dependencies group with 3 updates by @dependabot in #3076
• chore: update dependecies (geopandas 1+) by @kukushking in #3079
• chore(deps): bump botocore from 1.36.3 to 1.36.6 in the production-dependencies group by @dependabot in #3081
• chore(deps-dev): bump the development-dependencies group across 1 directory with 3 updates by @dependabot in #3083
• chore(deps): bump the production-dependencies group with 2 updates by @dependabot in #3087
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3088
• chore(deps): bump the production-dependencies group with 3 updates by @dependabot in #3097
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3098
• chore(deps): bump the production-dependencies group with 3 updates by @dependabot in #3101
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3102
• chore(deps): bump the production-dependencies group with 4 updates by @dependabot in #3105
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3106
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3109
• chore(deps): bump jinja2 from 3.1.5 to 3.1.6 by @dependabot in #3110
• chore(deps): bump the production-dependencies group with 2 updates by @dependabot in #3108
• chore(deps): bump aiohttp from 3.11.13 to 3.11.14 in the production-dependencies group by @dependabot in #3112
• chore(deps-dev): bump the development-dependencies group with 3 updates by @dependabot in #3113
• chore(deps): bump setuptools from 76.0.0 to 77.0.3 in the production-dependencies group by @dependabot in #3115
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3116
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3120
• chore(deps): bump setuptools from 77.0.3 to 78.1.0 in the production-dependencies group by @dependabot in #3119
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3126
• chore(deps): bump the production-dependencies group with 4 updates by @dependabot in #3125
• chore(deps-dev): bump the development-dependencies group across 1 directory with 4 updates by @dependabot in #3133
• chore(deps-dev): bump h11 from 0.14.0 to 0.16.0 by @dependabot in #3139
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3140
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3141
• chore(deps): bump the production-dependencies group across 1 directory with 4 updates by @dependabot in #3142
• chore(deps): bump the production-dependencies group with 2 updates by @dependabot in #3146
• chore(deps-dev): bump the development-dependencies group with 5 updates by @dependabot in #3147
• chore(deps): bump the production-dependencies group with 2 updates by @dependabot in #3150
• chore(deps-dev): bump the development-dependencies group with 4 updates by @dependabot in #3151
• chore(deps-dev): bump tornado from 6.4.2 to 6.5.1 by @dependabot in #3153

Documentation / Workflows 📚

• chore: Prepare 3.12.0 by @kukushking in #3154
• chore: update layers.rst by @EthanBunce in #3158

New Contributors

• @ashrielbrian made their first contribution in #3086
• @cournape made their first contribution in #2983
• @DanielMy777 made their first contribution in #3122
• @david-mateo made their first contribution in #3137
• @EthanBunce made their first contribution in #3156

Full Changelog: 3.11.0...3.12.0