# Mage

## Docs

- [Code of Conduct](https://mage-staging.mintlify.app/about/code-of-conduct.md): We've adopted the [Contributor Covenant](https://www.contributor-covenant.org/) Code of Conduct for the Mage community. Please review the following to understand our standards and expectations for participation.
- [Frequently Asked Questions](https://mage-staging.mintlify.app/about/frequently-asked-questions.md): Here are some frequently asked questions about Mage and our best answers.
- [Help improve the tool](https://mage-staging.mintlify.app/about/statistics.md): Please contribute usage statistics to help improve the developer experience for you and everyone in the community 🤝.
- [Create backfill](https://mage-staging.mintlify.app/api-reference/backfills/create-backfills.md)
- [Delete backfill](https://mage-staging.mintlify.app/api-reference/backfills/delete-backfill.md)
- [Overview](https://mage-staging.mintlify.app/api-reference/backfills/overview.md): Programmatically create multiple pipeline runs to backfill a pipeline.
- [Read backfills](https://mage-staging.mintlify.app/api-reference/backfills/read-backfills.md)
- [Update backfill](https://mage-staging.mintlify.app/api-reference/backfills/update-backfill.md)
- [Create block](https://mage-staging.mintlify.app/api-reference/blocks/create-block.md)
- [Delete block](https://mage-staging.mintlify.app/api-reference/blocks/delete-block.md)
- [Overview](https://mage-staging.mintlify.app/api-reference/blocks/overview.md): The Blocks API is used to create, update, and delete blocks objects from a pipeline.
- [Read block](https://mage-staging.mintlify.app/api-reference/blocks/read-block.md)
- [Update block](https://mage-staging.mintlify.app/api-reference/blocks/update-block.md)
- [Overview](https://mage-staging.mintlify.app/api-reference/logs/overview.md): Fetch log entries for your Mage instance.
- [Read logs](https://mage-staging.mintlify.app/api-reference/logs/read-logs.md)
- [Overview](https://mage-staging.mintlify.app/api-reference/oauth-access-tokens/overview.md): Fetch OAuth access tokens.
- [Read OAuth tokens](https://mage-staging.mintlify.app/api-reference/oauth-access-tokens/read-oauth-access-tokens.md)
- [API overview](https://mage-staging.mintlify.app/api-reference/overview.md): Our API powers everything in the app— our UI makes calls to the backend, which operates the app. You can learn more about how these work and make your own calls in this section.
- [Overview](https://mage-staging.mintlify.app/api-reference/pipeline-runs/overview.md): Status and metrics for an individual run of a pipeline.
- [Read pipeline runs](https://mage-staging.mintlify.app/api-reference/pipeline-runs/read-pipeline-runs.md)
- [Trigger pipeline](https://mage-staging.mintlify.app/api-reference/pipeline-runs/trigger-pipeline.md)
- [Overview](https://mage-staging.mintlify.app/api-reference/pipeline-schedules/overview.md): Triggers for a pipeline.
- [Read pipeline schedules](https://mage-staging.mintlify.app/api-reference/pipeline-schedules/read-pipeline-schedules.md)
- [Create pipeline](https://mage-staging.mintlify.app/api-reference/pipelines/create-pipeline.md)
- [Delete pipeline](https://mage-staging.mintlify.app/api-reference/pipelines/delete-pipeline.md)
- [Overview](https://mage-staging.mintlify.app/api-reference/pipelines/overview.md): Data pipeline containing execution settings, resources, block information, and block dependencies.
- [Read pipelines](https://mage-staging.mintlify.app/api-reference/pipelines/read-pipeline.md)
- [Update pipeline](https://mage-staging.mintlify.app/api-reference/pipelines/update-pipeline.md)
- [API policies](https://mage-staging.mintlify.app/api-reference/policies.md): Policies for resources determine what actions can be taken on the resource, what attributes can be read, and which attributes can be written.
- [API presenters](https://mage-staging.mintlify.app/api-reference/presenters.md): This will determine what attributes of the resource are returned to the client in the response. You can have different sets of attributes be included in the response based on the action (e.g. create, detail, delete, list, update) or a custom format.
- [API resources](https://mage-staging.mintlify.app/api-reference/resources.md): This file handles the CRUD operations.
- [Create session](https://mage-staging.mintlify.app/api-reference/sessions/create-session.md)
- [Overview](https://mage-staging.mintlify.app/api-reference/sessions/overview.md): Sign in and retrieve an OAuth token.
- [User defined permissions](https://mage-staging.mintlify.app/authentication/permissions/overview.md): Create granular permissions for CRUD operations on any API endpoint. Add permissions to roles and add roles to users.
- [Permissions](https://mage-staging.mintlify.app/authentication/permissions/permissions.md): Create granular permissions for CRUD operations on any API endpoint.
- [Roles](https://mage-staging.mintlify.app/authentication/permissions/roles.md): Add permissions to roles and add roles to users.
- [Adding an IO class](https://mage-staging.mintlify.app/contributing/backend/io/adding-a-class.md): IO classes power Mage sources and destinations. Read on to learn how you can contribute an IO class to Mage.
- [Contributing to the backend server](https://mage-staging.mintlify.app/contributing/backend/overview.md): Mage backend code is written in Python 🐍 and our server uses the Tornado 🌪️ framework. Here are some guides on adding features to the Mage backend.
- [Contributing](https://mage-staging.mintlify.app/contributing/backend/streaming/sources-and-destinations.md)
- [Testing](https://mage-staging.mintlify.app/contributing/backend/testing/overview.md): Making Mage invincible that nothing can break it, not even itself.
- [How to add a chart](https://mage-staging.mintlify.app/contributing/charts/how-to-add.md)
- [Adapt an existing source](https://mage-staging.mintlify.app/contributing/data-integrations/adapt-existing-source.md): Mage builds data integrations from [Singer taps](https://www.singer.io/#taps), so if there's a Singer source you want to use that isn't supported yet, you can adapt it yourself!
- [Create a new destination](https://mage-staging.mintlify.app/contributing/data-integrations/add-new-destination.md)
- [Create a new source](https://mage-staging.mintlify.app/contributing/data-integrations/add-new-source.md): This guide details adding a new source to Mage. If your source already exists as a [Singer tap](https://www.singer.io/#taps), check out [our guide](/contributing/data-integrations/adapt-existing-source) for adapting an existing source instead.
- [Configure your development environment](https://mage-staging.mintlify.app/contributing/development-environment.md): Want to get started contributing code? You're in the right place! Read on to learn how to set up your development environment.
- [Documentation](https://mage-staging.mintlify.app/contributing/documentation/overview.md): Like every other part of Mage, our documentation is open-source. Read on to learn how to make edits or even write entirely new docs for Mage!
- [Style Guide](https://mage-staging.mintlify.app/contributing/documentation/style-guide.md): Mage Docs are written in Markdown and deployed via Mintlify. This page is a style guide for contributing new documentation.
- [Contributing to the front-end client](https://mage-staging.mintlify.app/contributing/frontend/overview.md): Guides on adding features to the front-end client.
- [Contributing](https://mage-staging.mintlify.app/contributing/overview.md): We welcome all contributions to Mage; from small UI enhancements to brand new cleaning actions. We love seeing community members level up and give people power-ups!
- [Custom templates](https://mage-staging.mintlify.app/custom-templates/overview.md): Create custom block and pipeline templates for your project.
- [Using data integrations in batch pipelines](https://mage-staging.mintlify.app/data-integrations/batch-pipelines.md): Load data from data integration sources and export to data integration destinations as blocks inside batch pipelines.
- [Configure data integration pipelines](https://mage-staging.mintlify.app/data-integrations/configuration.md): There are many ways to configure your data integration pipeline.
- [Destinations technical documentation](https://mage-staging.mintlify.app/data-integrations/destinations/overview.md): A source is a system that you want to load data from and synchronize it into another system. A source can be a 3rd party API, SaaS, database, data warehouse, or a data lake.
- [Overview](https://mage-staging.mintlify.app/data-integrations/overview.md): Data integration is the process of synchronizing data between two systems.
- [Sources technical documentation](https://mage-staging.mintlify.app/data-integrations/sources/overview.md): A source is a system that you want to load data from and synchronize it into another system. A source can be a 3rd party API, SaaS, database, data warehouse, or a data lake.
- [Change Data Capture (CDC) with PostgreSQL](https://mage-staging.mintlify.app/data-integrations/sources/postgresql.md)
- [Add an existing dbt project to Mage](https://mage-staging.mintlify.app/dbt/add-existing-dbt.md): If you have an existing dbt project, you can add it to your Mage project.
- [dbt connection profiles](https://mage-staging.mintlify.app/dbt/connection-profiles.md)
- [Serve dbt docs in production](https://mage-staging.mintlify.app/dbt/docs.md): To serve dbt docs in production, you will need to enable a container to host the dbt docs webserver in the cloud service you are using.
- [Incremental models](https://mage-staging.mintlify.app/dbt/incremental-models.md)
- [dbt Integration](https://mage-staging.mintlify.app/dbt/overview.md): Transform dbt with Mage.
- [Run dbt-spark against a pySpark session.](https://mage-staging.mintlify.app/dbt/run-dbt-spark.md)
- [Run multiple models](https://mage-staging.mintlify.app/dbt/run-selected-model.md): (and optionally exclude others)
- [Run a single model](https://mage-staging.mintlify.app/dbt/run-single-model.md)
- [Running dbt tests](https://mage-staging.mintlify.app/dbt/running-dbt-tests.md)
- [Run dbt snapshot](https://mage-staging.mintlify.app/dbt/snapshots.md): Run multiple individual snapshots or bulk snapshots
- [dbt sources and upstream dependencies](https://mage-staging.mintlify.app/dbt/sources.md)
- [dbt variable interpolation](https://mage-staging.mintlify.app/dbt/variable-interpolation.md)
- [Project Structure](https://mage-staging.mintlify.app/design/abstractions/project-structure.md): Details about how the Mage file directory works and how typical projects are structured.
- [Overview](https://mage-staging.mintlify.app/design/blocks.md): Each block in a pipeline maps to an individual file within a project. Blocks can be reused and shared across multiple pipelines within the same project.
- [Callback blocks](https://mage-staging.mintlify.app/design/blocks/callbacks.md): A callback block is associated to another block. When the parent block succeeds or fails, the callback block functions are executed.
- [Conditional blocks](https://mage-staging.mintlify.app/design/blocks/conditionals.md): A conditional block is an 'Add-on Block' associated with another block. The condition will be evaluated before the parent block is executed, determining if the parent block gets executed.
- [Data exporter](https://mage-staging.mintlify.app/design/blocks/data-exporter.md): Once you’re done transforming your data, write code in these types of blocks to store that data or to train models and store those models elsewhere.
- [Data loader](https://mage-staging.mintlify.app/design/blocks/data-loader.md): Write your code for fetching data from a remote source or loading it from disk.
- [Dynamic blocks](https://mage-staging.mintlify.app/design/blocks/dynamic-blocks.md): Use the output of a block to dynamically create more blocks.
- [Extension block](https://mage-staging.mintlify.app/design/blocks/extension.md): An extension block adds extra functionality to blocks in your pipeline.
- [Scratchpad](https://mage-staging.mintlify.app/design/blocks/scratchpad.md): Use these blocks to experiment and write throw away code.
- [Sensor](https://mage-staging.mintlify.app/design/blocks/sensor.md): A sensor is a block that continuously evaluates a condition until it’s met or until a period of time has elapsed.
- [Transformer](https://mage-staging.mintlify.app/design/blocks/transformer.md): Use these blocks to clean, transform, and enhance data from other blocks.
- [Abstractions](https://mage-staging.mintlify.app/design/core-abstractions.md): These are the fundamental concepts that Mage uses to operate.
- [Core Design Principles](https://mage-staging.mintlify.app/design/core-design-principles.md): Every user experience and technical design decision adheres to these principles.
- [Data loader utilities](https://mage-staging.mintlify.app/design/data-loading.md)
- [Pipeline Management](https://mage-staging.mintlify.app/design/data-pipeline-management.md)
- [AI generated code](https://mage-staging.mintlify.app/development/ai/overview.md): Mage uses AI to help you build data pipelines faster— with our OpenAI integration, you can automate the tedious parts of pipeline development and focus on the fun stuff.
- [Callback templates](https://mage-staging.mintlify.app/development/blocks/callbacks/templates.md)
- [Conditional templates](https://mage-staging.mintlify.app/development/blocks/conditionals/templates.md)
- [Data exporter templates](https://mage-staging.mintlify.app/development/blocks/data_exporters/templates.md)
- [Data loader templates](https://mage-staging.mintlify.app/development/blocks/data_loaders/templates.md)
- [Sensor templates](https://mage-staging.mintlify.app/development/blocks/sensors/templates.md)
- [Transformer templates](https://mage-staging.mintlify.app/development/blocks/transformers/templates.md)
- [Data validation](https://mage-staging.mintlify.app/development/data-validation.md): Every data loader and transformer block has data validation capabilities built-in.
- [Import your own Python code](https://mage-staging.mintlify.app/development/dependencies/custom-files.md): You can import any Python code from any file that is in your Mage project directory.
- [Install Python packages](https://mage-staging.mintlify.app/development/dependencies/requirements.md): Use 3rd party Python packages in your project and pipelines.
- [Configure Git](https://mage-staging.mintlify.app/development/git/configure.md): This page will walk you through the process of authenticating with SSH or HTTPS and configuring Git for use with Mage Git Sync.
- [IO Config](https://mage-staging.mintlify.app/development/io_config.md): The `io_config` YAML file contains the information and credentials required to access databases, data warehouses, and data lakes.
- [Logging](https://mage-staging.mintlify.app/development/observability/logging.md)
- [Monitoring](https://mage-staging.mintlify.app/development/observability/monitoring.md): You can monitor many metrics for each of your pipelines and blocks.
- [Project setup](https://mage-staging.mintlify.app/development/project/setup.md): How to set up a folder containing your Mage project code and other files.
- [Great Expectations](https://mage-staging.mintlify.app/development/testing/great-expectations.md): Test the data produced by pipeline blocks using Great Expectations.
- [Unit tests](https://mage-staging.mintlify.app/development/testing/unit-tests.md): Write unit tests to test pipeline code.
- [Use an IDE](https://mage-staging.mintlify.app/development/text-editor.md): We love our UI, but here's how to develop in your favorite IDE, too.
- [Updating Mage](https://mage-staging.mintlify.app/development/updating-mage.md): How to get the latest and greatest from the Mage team.
- [Mage block variables](https://mage-staging.mintlify.app/development/variables/block-variables.md): Use pipeline-specific variables scoped to an individual block.
- [Mage environment variables](https://mage-staging.mintlify.app/development/variables/environment-variables.md): Configure Mage settings through environment variables.
- [Mage variables](https://mage-staging.mintlify.app/development/variables/overview.md): There are a few ways to set up variables in Mage, here's how you can use them to make the best pipelines the world has ever seen. 🌎
- [Accessing variables in Mage](https://mage-staging.mintlify.app/development/variables/referencing-variables.md): You've got all of these great variables and secrets, now let's put them to use. Learn how to access them in your code. 🦸🏻‍♂️
- [Secrets](https://mage-staging.mintlify.app/development/variables/secrets.md): Storing and using secrets through Mage
- [File versioning in Mage](https://mage-staging.mintlify.app/getting-started/file-versions.md): Mage can automatically keep track of previous versions of a file.
- [Kernels](https://mage-staging.mintlify.app/getting-started/kernels.md): We support multiple kernels in the code editor.
- [Pipeline variables and keyword arguments](https://mage-staging.mintlify.app/getting-started/runtime-variable.md)
- [Git in Mage](https://mage-staging.mintlify.app/getting-started/setting-up-git.md): There are a number of ways to enable version control, collaboration, and easy deployment using Git in Mage. We'll cover them all on this page.
- [Quickstart](https://mage-staging.mintlify.app/getting-started/setup.md): Go from zero to Mage hero in under a minute. We'll walk you through installing Mage and running your first pipeline. 🦸‍♀️
- [AI Clients](https://mage-staging.mintlify.app/guides/ai/ai-client.md): Use and enable differnt AI clients.
- [Using AI (artificial intelligence)](https://mage-staging.mintlify.app/guides/ai/overview.md): Use AI to perform various actions in Mage.
- [Custom blocks](https://mage-staging.mintlify.app/guides/blocks/custom-blocks.md): Custom blocks are generic blocks for organizing your pipeline that may not fit into any of the other category of blocks. Unlike Scratchpad blocks, Custom blocks are executed as part of the pipeline.
- [Dynamic blocks](https://mage-staging.mintlify.app/guides/blocks/dynamic-blocks.md): Create a pipeline with dynamic blocks.
- [Markdown blocks](https://mage-staging.mintlify.app/guides/blocks/markdown-blocks.md): A markdown block is a standalone text block that supports markdown and can be used to make notes or organize your blocks.
- [R blocks](https://mage-staging.mintlify.app/guides/blocks/r-blocks.md)
- [Replicating blocks](https://mage-staging.mintlify.app/guides/blocks/replicate-blocks.md): Reuse the same block multiple times within a single pipeline.
- [SQL blocks](https://mage-staging.mintlify.app/guides/blocks/sql-blocks.md): Execute SQL commands directly in your database, data warehouse, etc.
- [Transformer blocks](https://mage-staging.mintlify.app/guides/blocks/transformer-blocks.md): Transformer Actions are a library of modular, reusable data transformations, reducing the boilerplate to perform common transformations on your data.
- [Community Examples](https://mage-staging.mintlify.app/guides/community-examples.md): A collection of Mage projects and examples created by our community.
- [How to build a data integration pipeline](https://mage-staging.mintlify.app/guides/data-integration-pipeline.md): Here are the high level steps to build a data integration pipeline:
- [Develop dbt in Mage](https://mage-staging.mintlify.app/guides/dbt/developing-dbt-in-mage.md): Learn how to develop your favorite dbt models in Mage.
- [Connect a local db in Docker](https://mage-staging.mintlify.app/guides/docker/connecting-a-database.md): Here's how you can connect a local database to Mage in Docker for development.
- [Integrate Mage into an existing Airflow project](https://mage-staging.mintlify.app/guides/integrate-mage-airflow.md): In this tutorial, we’ll create a DAG in Airflow for scheduling and running a data pipeline; all from the Mage UI.
- [ETL pipeline tutorial](https://mage-staging.mintlify.app/guides/load-api-data.md): Build a data pipeline that loads restaurant data, transforms it, then exports it to a DuckDB database. 🦆
- [Mage Guides](https://mage-staging.mintlify.app/guides/overview.md): Mage guides for getting started, building pipelines, and more.
- [Make dbt magical](https://mage-staging.mintlify.app/guides/setup-dbt.md): ⏰ Run dbt models in Mage in under a minute.
- [Kafka streaming pipeline](https://mage-staging.mintlify.app/guides/streaming-pipeline.md): Build pipelines that ingest data from event streaming sources like Kafka.
- [RabbitMQ streaming pipeline](https://mage-staging.mintlify.app/guides/streaming-pipeline-rabbitmq.md): Build pipelines that ingest data from event streaming sources like RabbitMQ.
- [🎏 Local stream to dbt transform](https://mage-staging.mintlify.app/guides/streaming/magic-devcontainer.md): This project uses sample data from the Google NYC Taxi Pubsub to create a streaming pipeline in Mage that reads and transforms a sample stream, ultimately writing output to a SCD Type-2 table in Postgres.
- [Mage tips & tricks](https://mage-staging.mintlify.app/guides/tips-and-tricks.md): Here are all the great ways you can make the most of Mage.
- [Machine learning pipeline tutorial](https://mage-staging.mintlify.app/guides/train-model.md): Build a machine learning pipeline to train a model on the Titanic dataset.
- [Airbyte in Mage](https://mage-staging.mintlify.app/integrations/airbyte.md): Trigger a connection sync in Airbyte.
- [Run Mage pipelines in Airflow](https://mage-staging.mintlify.app/integrations/airflow.md)
- [BigQuery](https://mage-staging.mintlify.app/integrations/databases/BigQuery.md)
- [ClickHouse](https://mage-staging.mintlify.app/integrations/databases/ClickHouse.md)
- [Druid](https://mage-staging.mintlify.app/integrations/databases/Druid.md)
- [DuckDB](https://mage-staging.mintlify.app/integrations/databases/DuckDB.md): Execute SQL commands in DuckDB.
- [Google Sheets](https://mage-staging.mintlify.app/integrations/databases/GoogleSheets.md): Mage supports writing/reading from Google Sheets using the Google Sheets API via the gspread library. Read on to learn about reading/writing data to Sheets.
- [Microsoft SQL Server](https://mage-staging.mintlify.app/integrations/databases/MicrosoftSQLServer.md)
- [MongoDB](https://mage-staging.mintlify.app/integrations/databases/MongoDB.md)
- [MySQL](https://mage-staging.mintlify.app/integrations/databases/MySQL.md)
- [Pinot](https://mage-staging.mintlify.app/integrations/databases/Pinot.md)
- [PostgreSQL](https://mage-staging.mintlify.app/integrations/databases/PostgreSQL.md)
- [Redshift](https://mage-staging.mintlify.app/integrations/databases/Redshift.md)
- [S3](https://mage-staging.mintlify.app/integrations/databases/S3.md)
- [Snowflake](https://mage-staging.mintlify.app/integrations/databases/Snowflake.md)
- [Trino SQL blocks](https://mage-staging.mintlify.app/integrations/databases/trino.md): Execute SQL commands in Trino.
- [Databricks](https://mage-staging.mintlify.app/integrations/databricks.md): This is a guide for using Databricks Spark cluster with Mage.
- [dbt Cloud in Mage](https://mage-staging.mintlify.app/integrations/dbt-cloud.md): Trigger model runs in dbt Cloud.
- [Hightouch in Mage](https://mage-staging.mintlify.app/integrations/hightouch.md): Trigger syncs in Hightouch.
- [Alerting status updates in Email](https://mage-staging.mintlify.app/integrations/observability/alerting-email.md): Get status updates sent to your email inbox.
- [Alerting status updates in Opsgenie](https://mage-staging.mintlify.app/integrations/observability/alerting-opsgenie.md): Get status updates in Opsgenie.
- [Alerting status updates in Slack](https://mage-staging.mintlify.app/integrations/observability/alerting-slack.md): Get status updates in your Slack channel.
- [Alerting status updates in Teams](https://mage-staging.mintlify.app/integrations/observability/alerting-teams.md): Get status updates in your Teams channel.
- [Writing metrics to Datadog](https://mage-staging.mintlify.app/integrations/observability/datadog.md)
- [Great Expectations](https://mage-staging.mintlify.app/integrations/observability/great-expectations.md)
- [Metaplane in Mage](https://mage-staging.mintlify.app/integrations/observability/metaplane.md): Run monitors in Metaplane.
- [Monitoring with New Relic](https://mage-staging.mintlify.app/integrations/observability/newrelic.md)
- [Monitoring with Prometheus](https://mage-staging.mintlify.app/integrations/observability/prometheus.md)
- [Monitoring with Sentry](https://mage-staging.mintlify.app/integrations/observability/sentry.md)
- [Polars](https://mage-staging.mintlify.app/integrations/polars.md): Use Polars DataFrame in Mage blocks
- [Run Mage pipelines in Prefect](https://mage-staging.mintlify.app/integrations/prefect.md): We support running the pipeline in Prefect flows.
- [Spark and PySpark](https://mage-staging.mintlify.app/integrations/spark-pyspark.md): This is a guide for using Spark (PySpark) with Mage in different cloud providers or Kubernetes cluster.
- [Stitch in Mage](https://mage-staging.mintlify.app/integrations/stitch.md): Trigger syncs in Stitch.
- [No-code UI interactions](https://mage-staging.mintlify.app/interactions/overview.md): Configure and run pipelines using no-code UI text fields, dropdown menus, checkboxes, toggle switches, and more.
- [🧙‍♀️ Welcome to Mage](https://mage-staging.mintlify.app/introduction/overview.md): Mage is an open-source, hybrid framework for transforming and integrating data. ✨
- [Backfill guide](https://mage-staging.mintlify.app/orchestration/backfills/guides.md): How to create a backfill.
- [Backfilling pipelines](https://mage-staging.mintlify.app/orchestration/backfills/overview.md): Run a pipeline multiple times.
- [Global data products](https://mage-staging.mintlify.app/orchestration/global-data-products/overview.md): Generate and orchestrate the final output of a pipeline (aka data product). Data products can be globally referenced from any pipeline and its data output can be used in any block.
- [Retrying block runs from a pipeline run](https://mage-staging.mintlify.app/orchestration/pipeline-runs/retrying-block-runs.md)
- [Saving block output as CSV file](https://mage-staging.mintlify.app/orchestration/pipeline-runs/saving-block-output-as-csv.md)
- [Configure triggers in code](https://mage-staging.mintlify.app/orchestration/triggers/configure-triggers-in-code.md): Configure triggers in triggers.yaml under pipeline folder.
- [Trigger from AWS events](https://mage-staging.mintlify.app/orchestration/triggers/events/aws.md): Run a pipeline whenever an AWS event occurs.
- [Overview](https://mage-staging.mintlify.app/orchestration/triggers/events/overview.md): An event-type trigger will instruct the pipeline to run whenever a specific event occurs.
- [Schedules](https://mage-staging.mintlify.app/orchestration/triggers/schedule-pipelines.md): Schedule pipelines to run periodically
- [Trigger pipeline from a block](https://mage-staging.mintlify.app/orchestration/triggers/trigger-pipeline.md): You can trigger another pipeline from a block within a different pipeline.
- [Triggering pipeline via API request](https://mage-staging.mintlify.app/orchestration/triggers/trigger-pipeline-api.md): You can trigger a pipeline by making an API request.
- [Sign in with Google](https://mage-staging.mintlify.app/production/authentication/google.md): Enable signing in with a Google account in Mage.
- [Sign in with Microsoft](https://mage-staging.mintlify.app/production/authentication/microsoft.md): Enable signing in with Microsoft account in Mage.
- [Sign in with Okta](https://mage-staging.mintlify.app/production/authentication/okta.md): Enable signing in with Okta in Mage.
- [User authentication](https://mage-staging.mintlify.app/production/authentication/overview.md): Create users, manage users, and require sign in to authenticate and use Mage.
- [Buildkite](https://mage-staging.mintlify.app/production/ci-cd/local-cloud/buildkite.md): CI/CD with Buildkite.
- [GitHub Actions](https://mage-staging.mintlify.app/production/ci-cd/local-cloud/github-actions.md): Development (local) and production (cloud) using GitHub Actions.
- [GitLab CI/CD](https://mage-staging.mintlify.app/production/ci-cd/local-cloud/gitlab-ci-cd.md): Development (local) and production (cloud) using GitLab CI/CD.
- [Repository setup](https://mage-staging.mintlify.app/production/ci-cd/local-cloud/repository-setup.md): Setup your Mage project respository.
- [Overview](https://mage-staging.mintlify.app/production/ci-cd/overview.md): There are 4 development and deployment workflows.
- [Compute resources](https://mage-staging.mintlify.app/production/configuring-production-settings/compute-resource.md)
- [Production Configuration](https://mage-staging.mintlify.app/production/configuring-production-settings/overview.md)
- [One-way Git Sync](https://mage-staging.mintlify.app/production/data-sync/git-sync.md): Enabling one-way Git sync in Mage ensures data will be synced in one direction with a specified git repository.
- [GitHub integration](https://mage-staging.mintlify.app/production/data-sync/github.md): Authenticate with GitHub then pull from a remote repository, push local changes to a remote repository, and create pull requests for a remote repository.
- [Databases](https://mage-staging.mintlify.app/production/databases/default.md)
- [Architecture](https://mage-staging.mintlify.app/production/deploying-to-cloud/architecture.md)
- [Mage and Native Cloud Environments](https://mage-staging.mintlify.app/production/deploying-to-cloud/aws-without-terraform.md): Just like a traditional notebook, Mage supports execution in native cloud environments. Below are guides on how to integrate with native cloud resources.
- [AWS ECS deployment architecture](https://mage-staging.mintlify.app/production/deploying-to-cloud/aws/aws-ecs-architecture.md)
- [Deploy to AWS ECS with AWS CodePipeline](https://mage-staging.mintlify.app/production/deploying-to-cloud/aws/code-pipeline.md)
- [EMR policies](https://mage-staging.mintlify.app/production/deploying-to-cloud/aws/emr-policy.md)
- [Terraform AWS resources](https://mage-staging.mintlify.app/production/deploying-to-cloud/aws/resources.md)
- [Deploy to AWS with Terraform](https://mage-staging.mintlify.app/production/deploying-to-cloud/aws/setup.md)
- [AWS policies for Terraform apply](https://mage-staging.mintlify.app/production/deploying-to-cloud/aws/terraform-apply-policy.md)
- [AWS policies for Terraform destroy](https://mage-staging.mintlify.app/production/deploying-to-cloud/aws/terraform-destroy-policy.md)
- [Terraform Azure resources](https://mage-staging.mintlify.app/production/deploying-to-cloud/azure/resources.md)
- [Deploy to Azure with Terraform](https://mage-staging.mintlify.app/production/deploying-to-cloud/azure/setup.md)
- [Deploy to DigitalOcean with Terraform](https://mage-staging.mintlify.app/production/deploying-to-cloud/digitalocean/setup.md)
- [Push Docker Image to GCP Artifact Registry](https://mage-staging.mintlify.app/production/deploying-to-cloud/gcp/gcp-artifact-registry.md)
- [Terraform GCP resources](https://mage-staging.mintlify.app/production/deploying-to-cloud/gcp/resources.md)
- [Deploy to GCP with Terraform](https://mage-staging.mintlify.app/production/deploying-to-cloud/gcp/setup.md)
- [AWS Secrets Manager](https://mage-staging.mintlify.app/production/deploying-to-cloud/secrets/AWS.md)
- [Azure Key Vault](https://mage-staging.mintlify.app/production/deploying-to-cloud/secrets/Azure.md)
- [GCP Secrets Management](https://mage-staging.mintlify.app/production/deploying-to-cloud/secrets/GCP.md)
- [Helm](https://mage-staging.mintlify.app/production/deploying-to-cloud/using-helm.md)
- [Terraform](https://mage-staging.mintlify.app/production/deploying-to-cloud/using-terraform.md)
- [AWS Elastic Container Service](https://mage-staging.mintlify.app/production/developing-in-the-cloud/cloud-dev-environments/aws-ecs.md)
- [Google Cloud Run](https://mage-staging.mintlify.app/production/developing-in-the-cloud/cloud-dev-environments/cloud-run.md)
- [Kubernetes](https://mage-staging.mintlify.app/production/developing-in-the-cloud/cloud-dev-environments/kubernetes.md)
- [Multi-development environment in the cloud](https://mage-staging.mintlify.app/production/developing-in-the-cloud/cloud-dev-environments/overview.md): Mage is designed and built to be cloud native.
- [Kubernetes](https://mage-staging.mintlify.app/production/developing-in-the-cloud/workspaces/kubernetes.md)
- [Workspace management (in Beta)](https://mage-staging.mintlify.app/production/developing-in-the-cloud/workspaces/overview.md): Use Mage in multiple workspaces in the cloud
- [Amazon S3](https://mage-staging.mintlify.app/streaming/destinations/amazon-s3.md)
- [BigQuery](https://mage-staging.mintlify.app/streaming/destinations/bigquery.md)
- [ClickHouse](https://mage-staging.mintlify.app/streaming/destinations/clickhouse.md)
- [DuckDB](https://mage-staging.mintlify.app/streaming/destinations/duckdb.md)
- [Dummy](https://mage-staging.mintlify.app/streaming/destinations/dummy.md)
- [Elasticsearch](https://mage-staging.mintlify.app/streaming/destinations/elasticsearch.md)
- [Google Cloud PubSub](https://mage-staging.mintlify.app/streaming/destinations/google-cloud-pubsub.md)
- [InfluxDB](https://mage-staging.mintlify.app/streaming/destinations/influxdb.md)
- [Kafka](https://mage-staging.mintlify.app/streaming/destinations/kafka.md)
- [Kinesis](https://mage-staging.mintlify.app/streaming/destinations/kinesis.md)
- [MongoDB](https://mage-staging.mintlify.app/streaming/destinations/mongodb.md)
- [Microsoft SQL Server](https://mage-staging.mintlify.app/streaming/destinations/mssql.md)
- [MySQL](https://mage-staging.mintlify.app/streaming/destinations/mysql.md)
- [Opensearch](https://mage-staging.mintlify.app/streaming/destinations/opensearch.md)
- [Postgres](https://mage-staging.mintlify.app/streaming/destinations/postgres.md)
- [Redshift](https://mage-staging.mintlify.app/streaming/destinations/redshift.md)
- [Snowflake](https://mage-staging.mintlify.app/streaming/destinations/snowflake.md)
- [Trino](https://mage-staging.mintlify.app/streaming/destinations/trino.md)
- [Overview](https://mage-staging.mintlify.app/streaming/overview.md)
- [ActiveMQ](https://mage-staging.mintlify.app/streaming/sources/activemq.md)
- [Amazon SQS](https://mage-staging.mintlify.app/streaming/sources/amazon-sqs.md)
- [Azure Event Hub](https://mage-staging.mintlify.app/streaming/sources/azure-event-hub.md)
- [Google Cloud PubSub](https://mage-staging.mintlify.app/streaming/sources/google-cloud-pubsub.md): Ingest data from Google Cloud PubSub event streaming sources.
- [InfluxDB](https://mage-staging.mintlify.app/streaming/sources/influxdb.md)
- [Kafka](https://mage-staging.mintlify.app/streaming/sources/kafka.md)
- [Kinesis](https://mage-staging.mintlify.app/streaming/sources/kinesis.md)
- [Customizable dashboards](https://mage-staging.mintlify.app/visualizations/dashboards.md): There are 2 dashboards: a dashboard for all your pipelines and a dashboard for each pipeline. You can add charts of various types with different sources of data. Use these dashboards for observability or for analytics.

## Optional

- [Releases](https://docs.mage.ai/about/releases)
- [Roadmap](https://docs.mage.ai/about/roadmap)
- [Troubleshooting](https://docs.mage.ai/development/troubleshooting)
- [Slack](https://www.mage.ai/chat)