> ## Documentation Index
> Fetch the complete documentation index at: https://docs.utopikai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# S3 Connector

> Access documents stored in Amazon S3 buckets

## How it works

The S3 connector pulls in all documents from the specified Amazon S3 bucket. It supports various file formats including PDF, DOC, DOCX, TXT, and more.

Documents are updated every **1** day.

## Setting up

### Authorization

1. Log into your AWS Management Console.
2. Navigate to the IAM (Identity and Access Management) dashboard.
3. In the left sidebar, click on "Users" and then "Create user".

<img src="https://mintcdn.com/utopikai/g8jaLDrzOAAW8fQL/images/connectors/blob/s3/iam.png?fit=max&auto=format&n=g8jaLDrzOAAW8fQL&q=85&s=23019ea82a1a55ebbb2896e043a8f2eb" alt="IAM page" width="3450" height="754" data-path="images/connectors/blob/s3/iam.png" />

4. Set a name for the new user (e.g., "UtopikAIS3Connector") and click "Next".
5. Click "Attach policies directly" and search for "AmazonS3ReadOnlyAccess" or a similarly permissive policy.
6. Select this policy and click "Next".
7. Add any tags if needed, then click "Create user".
8. You'll now be on the `users` page. Click on the user you just created.
9. Click "create access key" and select "Third-party service"
10. Select "I understand the above recommendation and want to proceed to create an access key" and then "Next".
11. Optionally, set a description tag and then press "create access key".
12. You should now see, you'll see the Access Key ID and Secret Access Key. Make sure to copy these immediately as you won't be able to access the Secret Access Key again.

<img src="https://mintcdn.com/utopikai/g8jaLDrzOAAW8fQL/images/connectors/blob/s3/accesskeyspage.png?fit=max&auto=format&n=g8jaLDrzOAAW8fQL&q=85&s=db90ef7b922113a6206397b1ca25929c" alt="AWS Credentials" width="3338" height="1644" data-path="images/connectors/blob/s3/accesskeyspage.png" />

### Indexing

1. Navigate to the Admin Dashboard and select the **S3** Connector.
2. In **Step 1**, provide your AWS credentials:

<img src="https://mintlify.s3.us-west-1.amazonaws.com/utopikai/images/connectors/blob/s3/UtopikAI1.png" alt="UtopikAI S3 page 1" />

* If AWS Access Key ID and AWS Secret Access Key are provided, they will be used for authenticating the connector.
* Otherwise, the Profile Name will be used (if provided).
* If no credentials are provided, then the connector will try to authenticate with any default AWS credentials available.

**AWS Access Key ID:**
**AWS Secret Access Key:**
**Profile Name:**

3. Click "Update" to save your credentials.

4. In **Step 2**, specify which S3 bucket you want to make searchable:

<img src="https://mintlify.s3.us-west-1.amazonaws.com/utopikai/images/connectors/blob/s3/UtopikAI2.png" alt="UtopikAI S3 page 2" />

5. Click "Connect" to begin indexing.

You should now see a page like below and be able to add more buckets with the same credentials!

<img src="https://mintlify.s3.us-west-1.amazonaws.com/utopikai/images/connectors/blob/s3/UtopikAI3.png" alt="UtopikAI S3 page 3" />

## Understanding S3 Structure

Amazon S3 organizes data into buckets. Each bucket can contain an unlimited number of objects (files). You can think of a bucket as a root directory, and the objects as files within that directory.

For more information on S3 structure, visit the [Amazon S3 documentation](https://docs.aws.amazon.com/AmazonS3/latest/userguide/Welcome.html).
