tap-massive

tap-massive is a Singer tap for Massive.

Built with the Meltano Tap SDK for Singer Taps.

Configuration

Accepted Config Options

A full list of supported settings and capabilities for this tap is available by running:

tap-massive --about

Configure using environment variables

This Singer tap will automatically import any environment variables within the working directory's .env if the --config=ENV is provided, such that config values will be considered if a matching environment variable is set either in the terminal context or in the .env file.

Source Authentication and Authorization

Usage

You can easily run tap-massive by itself or in a pipeline using Meltano.

Executing the Tap Directly

tap-massive --version
tap-massive --help
tap-massive --config CONFIG --discover > ./catalog.json

Developer Resources

Follow these instructions to contribute to this project.

Initialize your Development Environment

Prerequisites:

• Python 3.9+
• uv

uv sync

Create and Run Tests

Create tests within the tests subfolder and then run:

uv run pytest

You can also test the tap-massive CLI interface directly using uv run:

uv run tap-massive --help

Testing with Meltano

Note: This tap will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.

Next, install Meltano (if you haven't already) and any needed plugins:

# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-massive
meltano install

Now you can test and orchestrate using Meltano:

# Test invocation:
meltano invoke tap-massive --version

# OR run a test ELT pipeline:
meltano run tap-massive target-jsonl

Flat File Streams

The flat file streams read historical market data from local CSV/CSV.gz files (e.g., stocks EOD, 1-minute bars, trades, quotes). Before running these streams, fetch the data files by running:

./fetch_massive_flat_files.sh

Then set flat_files_base_dir in your tap config (or MASSIVE_FLAT_FILES_BASE_DIR env var) to the directory containing the asset-class subdirectories (e.g., us_stocks_sip/eod/, global_crypto/bars_1m/).

SDK Dev Guide

See the dev guide for more instructions on how to use the SDK to develop your own taps and targets.