Setup Guide

To get started, you'll need to create an account to access the FireTail platform.

1. Go to firetail.app.
2. Click Get Started.
3. Enter an email address and password, or click Continue with Google to sign in with your Google account.

Follow the on-screen instructions to complete registration. For more information, see How do I create an account.

When your account is set up, the next step is to create an organization. Organizations act as isolated workspaces for managing users, projects, AI Workload integrations, alerts and more.

• You can also create organizations later from the dropdown menu.
• Choose a subscription plan. A 7-day free trial of the Business plan is available.

Note: Each organization is separate, and nothing is shared between them. Members added to one organization do not have access to others unless added separately.

Learn more:

• Create an organization
• Manage subscriptions and billing
• Add a new member to an organization

Projects are logical containers that help organize and manage resources within the platform.

1. In the side menu go to Platform and select Projects.
2. Click Create Project and enter the required details.

Note: Projects are necessary for discovering and creating resources within the platform.

Learn more about projects here.

Set up integrations to gain full visibility into your AI resources. FireTail supports automated discovery by connecting to your cloud environments and repositories.

AI Resource Discovery

FireTail organizes AI assets by provider (e.g., OpenAI, AWS Bedrock, Azure OpenAI) and captures key metadata, such as:

• Token usage
• Latency metrics
• Input/output schema formats
• Response types and safety configurations

This enables full lifecycle observability across AI-driven applications and helps surface potential risks related to model misuse, data leakage, or excessive token consumption.

To discover AI resources:

• Use the same Integrations section.
• Set up discovery for AI-related services within your cloud provider integrations (e.g., AWS, Azure OpenAI).
• FireTail will automatically detect and catalog supported AI resources.

Learn more:

• AWS Inventory Scanning
• Azure Inventory Scanning
• Google Cloud Inventory Scanning
• GitHub Repo Scanning (GitHub App)
• GitLab Repo Scanning

Set up notification integrations to receive alerts when specific conditions are met-such as anomalous behavior, threshold breaches, or AI model misuse.

FireTail supports a variety of notification channels to fit your workflows. You'll need at least one integration configured before creating alerts.

Learn more:

• Slack Webhook
• Microsoft Teams
• Lambda Function
• Jira Integration
• HTTP Webhook
• AWS WAFv2 IP Set
• Splunk Integration
• PagerDuty Integration
• Email notification
• ServiceNow Integration
• SMTP Email Notification

FireTail's alerting system enables you to monitor your AI environments for abnormal activity, policy violations, or predefined thresholds.

You can define two types of alerts:

• Static alerts: Triggered when fixed thresholds are met (e.g., number of failed auth attempts, response size).
• Anomaly alerts: Use historical data to detect unusual activity such as token spikes, suspicious inputs, or response anomalies from AI services.

FireTail also includes managed alert filters that automatically detect common risks such as:

• SQL injection attempts
• Authentication failures
• Secret exposure
• Unsafe AI model output or token overuse
• Suspicious geographies or traffic spikes

Connect FireTail with logging services to centralize and monitor traffic across your AI endpoints. Logs provide visibility into behavior, usage trends, and security events.

Learn more:

• AWS Bedrock logging with AWS Lambda
• Chrome Browser Extension
• OpenAI Logging