Dremio Tasks

---

This module contains a collection of tasks for interacting with Dremio Query Engine via the pyarrow library.

DremioFetch

class

prefect.tasks.dremio.dremio.DremioFetch

(username=None, password=None, hostname=None, flightport=32010, tls=False, certs=None, query=None, **kwargs)[source]

Task for fetching results of a query using Dremio Query Engine.

Args:

• username (str): user name used to authenticate
• password (str): password used to authenticate
• hostname (str): Dremio host address
• flightport (int, optional): port used to connect to FlightClient, defaults to 32010 if not provided
• tls (bool): connect to the server endpoint with an encrypted TLS connection
• certs (str): path to a certificate
• query (str, optional): query to execute against Dremio
• **kwargs (Any, optional): additional keyword arguments to pass to the Task constructor

methods:
prefect.tasks.dremio.dremio.DremioFetch.run (username, password, hostname, flightport, tls, certs, query)[source]
Task run method. Executes a query against Dremio and fetches results. Args: username (str): user name used to authenticate password (str): password used to authenticate hostname (str): Dremio host address flightport (int, optional): port used to connect to FlightClient, defaults to 32010 if not provided tls (bool): connect to the server endpoint with an encrypted TLS connection certs (str): path to a certificate query (str, optional): query to execute against query engine Returns: dict: a dictionary of data returned by Dremio Raises: ValueError: if query is None

---

This documentation was auto-generated from commit bd9182e
on July 31, 2024 at 18:02 UTC