Gig Fusion Event Search

AI agent guidance for working with the Gig Fusion concert events project. This skill helps you understand the data flow, setup process, and conventions for the gig-fusion repository.

Data Flow Overview

1. **Scrapers/parsers** produce JSON files named `concert_events_*.json` at the repo root

2. **Notebooks** read the latest JSON via `load_latest_events()` (see `ingest.ipynb`)

3. **Events** are pushed to a local Meilisearch index named `events`

4. **Search backend** stores indexes under `data/data.ms/` (persistent data - do not delete)

Quick Setup

1. Create Conda Environment

```bash

conda env create -f environment.yml

conda activate eventing

```

2. Start Meilisearch with Docker

```bash

docker run --rm -it -p 7700:7700 \

-v "$PWD/data/data.ms:/data.ms" \

-e MEILI_MASTER_KEY="<your-key>" \

getmeili/meilisearch:latest \

meilisearch --db-path /data.ms --master-key "$MEILI_MASTER_KEY"

```

3. Index Events

Open `ingest.ipynb` in JupyterLab and run the cells to index the latest `concert_events_*.json` into the `events` index.

Repository-Specific Patterns

File Naming Convention

Indexing Pattern

Code in `ingest.ipynb` follows this pattern:

```python

index.add_documents(events, primary_key="id")

index.update_searchable_attributes([...])

index.update_filterable_attributes([...])

index.update_sortable_attributes([...])

```

When adding new fields, update all three attribute lists as appropriate.

Meilisearch Configuration

```python

import os

import meilisearch

client = meilisearch.Client(

os.getenv('MEILI_URL', 'http://localhost:7700'),

os.getenv('MEILI_API_KEY')

)

```

Search Query Example

Faceted search from `ingest.ipynb`:

```python

facet_fields = ["location", "status_kind", "price_eur", "date", "band"]

result = index.search(

"sonic",

{

"filter": 'price_eur < 50 AND status_kind != "ausverkauft"',

"facets": facet_fields,

"sort": ["date:desc"],

"limit": 1000,

}

)

```

Key Files & Locations

Dependencies

External Services

Python Packages (via `environment.yml`)

Editing Conventions

DO:

DO NOT:

Security Best Practices

If you find hard-coded API keys in notebooks:

1. Replace with environment variable lookups: `os.getenv('MEILI_API_KEY')`

2. Document the change in the commit message

3. Recommend the user add the key to their environment or `.env` file

Component Architecture