# Dremio Tasks

This module contains a collection of tasks for interacting with Dremio Query Engine via the pyarrow library.

# DremioFetch

class

prefect.tasks.dremio.dremio.DremioFetch

(user, password, host, port=32010, query=None, **kwargs)[source]

Task for fetching results of a query using Dremio Query Engine.

Args:

user (str): user name used to authenticate
password (str): password used to authenticate
host (str): Dremio host address
port (int, optional): port used to connect to FlightClient, defaults to 32010 if not provided
query (str, optional): query to execute against Dremio
**kwargs (Any, optional): additional keyword arguments to pass to the Task constructor

methods:

methods:
prefect.tasks.dremio.dremio.DremioFetch.run (user, password, host, port, query)[source]
Task run method. Executes a query against Dremio and fetches results. Args: `user (str)`: user name used to authenticate `password (str)`: password used to authenticate `host (str)`: Dremio host address `port (int, optional)`: port used to connect to FlightClient, defaults to 32010 if not provided `query (str, optional)`: query to execute against query engine Returns: `dict`: a dictionary of data returned by Dremio Raises: `ValueError`: if `query` is `None`

prefect.tasks.dremio.dremio.DremioFetch.run

(user, password, host, port, query)[source]

Task run method. Executes a query against Dremio and fetches results.

Args:

user (str): user name used to authenticate
password (str): password used to authenticate
host (str): Dremio host address
port (int, optional): port used to connect to FlightClient, defaults to 32010 if not provided
query (str, optional): query to execute against query engine

Returns:

Raises:

This documentation was auto-generated from commit n/a
on July 1, 2021 at 18:35 UTC