Running your EL tasks from the CLI has never been easier. Got a CSV or JSON file? Simple pipe the data into sling, and it will automatically detect the proper column datatypes and create a database table for you. It would look something like this:
cat my_file.csv | sling run --tgt-conn MYDB --tgt-object my_schema.my_table
Core engine is written in Go and adopts a streaming design, making it super efficient by holding minimal data in memory
Easily replicate data from a source database, file or SaaS connection to a destination database or file. Define the configuration in a YAML file.
Sling allows you to run your own operation in whatever environment you prefer.
With the list sub-command, we can display all connections available from our Sling Env File as well as Environment Variable. Oh, are your using dbt profiles? Sling picks those up too!
The Sling CLI tool also allows testing connections. Once we know the connection name, we can use the sling conns test command.
The discover sub-command displays which streams are available for sling is read from for a particular connection. You can even filter by schema for database connections, or by folder for storage connections.
You can easily define your replications in YAML files. You're able to specify default values as well as naming patterns! Check the docs here for more details.
For any additional questions, feel free to send a message here .
Many connection types are supported including MySQL, Oracle, Postgres, SQL Server, AWS S3, Google File Storage, Azure Storage, SFTP and more. See here for a complete list.
Yes it is! Just install it on your machine and use it as you wish. No strings attached. The plan is to open source soon.
