Inventory

The FireTail platform helps you discover and monitor AI resources-such as AI services, models, prompts, and logs-within your codebase or cloud environment.

Integrations

Before you can discover AI resources, you must set up integrations with your environments. When the integrations are configured, FireTail will automatically scan your environments for AI resources.

AI Services

An AI service acts as the interface between users and the underlying AI models. It accepts inputs, processes them using the model, and returns the output. To view AI Services:

1. In the side menu, select AI.
2. Service Details: Click on an individual AI service to see its details, which include:
   • Resources Grouped by Providers: Lists the resources organized by provider (e.g., OpenAI, Cohere, Amazon, Anthropic). This section shows a count of models, prompts, logs input and output tokens and total number of tokens per provider.

• AI logs grouped by provider: A chart that displays the number of logs generated by the service over the displayed time period, grouped by provider. Learn more about Cloud Logs.

• Total tokens metric by datetime: A graph showing how token usage varies over time.

• Resources: A display of all AI models, AI prompts and AI logs associated with the service. Click the model, prompt or log to view more details.

AI Models

An AI model processes data, identifies patterns, and makes predictions or generates outputs.

1. In the side menu, go to AI and under Inventory select Models.
2. All discovered AI models are displayed.
3. Click on a model to view further details, including:
   • Model Name: Identifies the AI model.
   • Provider: Identifies the provider (e.g., OpenAI, Cohere, AI21 Labs).
   • Scanned Via & Source: Specifies how the model was discovered (e.g., AWS Bedrock, Cloudwatch).
   • Creation & Modification Timestamps: Tracks when the model was first detected and last updated.
   • Model Metadata: Includes details such as:
     • Account ID: Identifies the cloud account associated with the model.
     • Model ARN: The unique Amazon Resource Name (ARN) for AWS-hosted models.
     • Model ID: A version-specific identifier (e.g., ai21.jamba-instruct-v1:0).
     • Discovery Method: Specifies how the model was found (e.g., CloudWatch logs).
     • Region Name: The geographical cloud region where the model is deployed (e.g., us-east-1).
     • Response Streaming Supported: Indicates whether the model supports real-time streaming responses.

• Prompts: Information about the prompts associated with the model.
• Logs: Detailed records showing when the model was called, what inputs were used, and what outputs were generated

AI Prompts

AI prompts are the specific inputs provided to an AI model. They guide the model's output and record the interaction details. To view prompts, you can

• In the side menu, go to AI and under Inventory select Prompts.
• Click on an AI model to view its associated prompts. Select a prompt by clicking its ID.

Prompt Details can include:

• Name and Model: Identification of the prompt and the model it belongs to.
• Provider and Scanned Via: Information on who provided the prompt and how it was discovered.
• Creation Date and Last Modified: When the prompt was created and last updated.
• Temperature and Response Format: Settings that control the randomness of the output and the format in which responses are generated.
• Messages: A record of the prompts.

AI Users

AI users represent the individuals within your organization who interact with AI services and platforms. To view users, you can

• In the side menu, go to AI and under Inventory select Users.
• Click on an AI platform to view its associated users. Select a user by clicking their card.

User Details can include:

• Name and Email: Identification of the user and their associated email addresses.
• Creation Date and Last Modified: When the user was created and last used an AI platform.
• Department and Groups: What department the user works in, and how many groups they are a part of.
• Consumptions: A summary of AI usage and consumption metrics.
• Logs: Associated logs that record the user's interactions with AI platforms.

Workforce Groups

Workforce Groups allow you to organize users into logical collections, making it easier to manage access and apply Browser Policies consistently across your organization.

• In the side menu, go to AI and under Inventory select Groups.
• Click on an AI user to view its associated groups.
• Click on an AI platform to view its associated users. Select a user by clicking their card to view its associated groups.

Group Details can include:

• Name: The group’s identifier.
• Description: A brief overview of the group’s purpose or scope.
• Creation Date and Last Modified: When the group was created and most recently updated.
• Projects: Projects linked to the group.
• Users: A list of all members within the group.

AI Platforms

AI platforms are the AI-related services used by users within your organization. To view platforms, you can

• In the side menu, go to AI and under Inventory select Platforms.

Platform Details can include:

• Name: Identification of the platform.
• Creation Date and Last Modified: When the platform was created and last used.
• Users: All users who have interacted with the platform.
• Logs: Associated logs recording interactions with the platform.