All integrations

Meltano

Meltano is an open source ELT DataOps framework to transfer and transform data among various types of data sources. Meltano leverages Singer, an open source data exchange format specification, to define its ELT components and has plugins for hundreds of popular SaaS platforms.

Connect to Catalog & Interactions & Users

Introduction

Meltano is an open source ELT DataOps framework to transfer and transform data among various types of data sources. Meltano leverages Singer, an open source data exchange format specification, to define its ELT components and has plugins for hundreds of popular SaaS platforms. Miso participates in this ecosystem by building target-miso, an open source Singer component, which helps you push your data to Miso’s Search and Recommendation engine in automation with ease.

Integration Steps

Build your Meltano project

  1. Follow Meltano’s guide to install the framework (Note: You can either install Python and the Meltano package to your local machine or use their official docker image for the environment).

  2. Setup your project skeleton using our examples.

  3. Configure an extractor for your data warehouse. You can search for an existing extractor from Meltano’s Hub, or try searching online if yours is unlisted. Some common extractors include:

  4. Follow this guide to configure the loader (target-miso) to pipe your data to Miso’s engine.

  5. Optional: You can configure an orchestrator, like Airflow, to automate and schedule the data flow.

Tips and Tricks

  • In Meltano’s CLI, you can use --dry-run flag to test the configuration.
  • Use the discover capability of your tap to confirm stream IDs.
  • Use meltano invoke tap-* --test to emit a single record for testing purposes.
  • Use meltano invoke target-* --input to test a loader.

Additional Resources

For more information on Miso’s API, check out the official API Documentation.

For more Integrations like this, visit the Integrations page on our Docs site.

For more information on getting started with Meltano, see their official documentation.

Published Date: June 27th, 2022

Icon/Activity Icon/Add Icon/API Icon/Arrow/Down Icon/Arrow/Left Icon/Arrow/Right Icon/Arrow/TopRight Icon/Arrow/Up Icon/Bento Icon/Billing Icon/Bin Icon/Book Icon/Bookmark/Default Icon/Bookmark/Filled Icon/Calendar Icon/Caret/Down Icon/Caret/Up Icon/Chavron/DownIcon/Chavron/LeftIcon/Chavron/RightIcon/Chavron/UpIcon/Checknox/CheckedIcon/Checknox/Unchecked Icon/Checklist Icon/Chip Icon/Clipboard / Copied Icon/Clipboard/Default Icon/Clock/Stopwatch Icon/CMD Icon/Data/Catalog Icon/Data/Engine Icon/Data/Group Icon/Data/Interact Icon/Data/Users Icon/Dive Icon/Docs/Key Icon/Dojo Icon/Email Icon/Env/Development Icon/Env/Playground Icon/Env/Prod Icon/Folder Icon/Fullscreen/Collapse Icon/Fullscreen/Expand Icon/Guides/Multiple Icon/Guides/Single Icon/Hashtag Icon/Heart/Outline Icon/Heart/Solid Icon / Cart z Icon / Click Icon / Clock Icon / Data Icon / Doc Icon / EmptyCart z Icon/Social/Facebook Icon / Genome Incognito Icon / Money Icon/Social/ProductHunt Icon / Search Icon/Social/Twitter Icon / User Icon/Info/Error Icon/Info/Info Icon/Info/Question Icon/Info/Warning Icon/Interact/Download Icon/Interact/Edit Icon/Interact/External v2 Icon/Interact/External Icon/Interact/Filter Icon/Interact/Logout Icon/Interact/Options Icon/Interact/Re-order Icon/Interact/Reload Icon/Interact/Remove Icon/Interact/Replace Icon/Interact/Search Icon/Interact/Shuffle Icon/Interact/Undo Icon/Interact/Upload Icon/Interact/Video Icon/Invoice Icon/Loading Icon/Loading Icon/Lock/Locked Icon/Lock/Unlocked Icon/Lock Icon/Mapping Menu Icon/Notification Icon/Overview Icon/Person/Team Icon/Person/User Icon/Plan/Enterprise Icon/Plan/Growth Icon/Plan/Startup Icon/Plan/Trial Icon/Recipe Icon/Rocket Icon/Settings/App Icon/Settings/User Icon/Settings Icon/Shrine Icon/Sidebar/Close Icon/Sidebar/Open Icon/Slideout Icon/Sort/Ascending Icon/Sort/Default Icon/Sort/Descending Icon/Star/Filled Icon/Star/Outlined Stopwatch Icon/Support Icon/Tag Icon/Interact/Thumb/Dislike Icon/Interact/Thumb/Like Icon/Tick Icon/Trend/New Icon/Trend/Trending Icon/Tutorial Icon/Lock/Unlocked Icon/View/Grid Icon/View/List Icon/Watchlist/Add