Skip to content

feat: [Athena] Make s3_staging_dir optional #11792

@Cabeda

Description

@Cabeda

Is your feature request related to a problem?

Currently, as ibis uses pyAthena we could replace the s3_staging_dir with a work_group (with laughingman7743/PyAthena#629) so that we can leverage Athena's managed outputs

What is the motivation behind your request?

Avoid creating buckets and managing the athena outputs ourselves

Describe the solution you'd like

Instead of the mandatory

import ibis

con = ibis.athena.connect(s3_staging_dir="s3://...")

we can

import ibis

con = ibis.athena.connect(workgroup="primary")

or even better assume primary as the default workgroup and we can just

import ibis

con = ibis.athena.connect()

What version of ibis are you running?

11.0.0

What backend(s) are you using, if any?

athena

Code of Conduct

  • I agree to follow this project's Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    featureFeatures or general enhancements

    Type

    No type

    Projects

    Status

    backlog

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions