Files
OKF_Vault/knowledge/data/stadt-heilbronn-media-mentions.md
T
Noel Sabia 7b9893a89e feat: add OKF knowledge bundle for hackathon challenges
Capture all six Future City Hackathon 2026 challenges as OKF v0.2 concepts, with dataset and organizer concepts, indexes, and a log.

Configure release-please with the simple strategy so the first release PR bumps the repository from 0.0.0 to 0.1.0.
2026-11-13 18:23:00 +01:00

114 lines
6.1 KiB
Markdown

---
type: Dataset
title: Stadt Heilbronn media mentions
description: 39,361 keyword-filtered social media and news records from October 2024 to October 2026 covering Heilbronn's cable-car debate, the IPAI project, and comparable cable-car projects.
resource: ../../Stadt%20Heilbronn/FSI_Heilbronn_Medienbeitr%C3%A4ge%20(1).json
tags: [dataset, stadt-heilbronn, media-monitoring, sentiment, nlp, cable-car, ipai]
status: stable
generated: { by: opencode/deepseek-v4.1-flash, at: 2026-11-13T17:13:56Z }
sources:
- id: media-export
resource: ../../Stadt%20Heilbronn/FSI_Heilbronn_Medienbeitr%C3%A4ge%20(1).json
title: "FSI_Heilbronn_Medienbeiträge (1).json — media mention export"
- id: seilbahn-readme
resource: ../../Stadt%20Heilbronn/readme%20Seilbahn_Challenge.docx
title: "Riding the Sentiment — Seilbahn challenge README"
author: team:stadt-heilbronn
---
# Overview
This dataset supports the [Stadt Heilbronn cable-car sentiment challenge](/challenges/stadt-heilbronn-cable-car-sentiment.md). It is a media-monitoring export of publicly accessible social media and news content, collected without login and without circumventing technical access restrictions. Direct personal identifiers are not included.[^seilbahn-readme]
The export was pre-filtered with the keywords `IPAI`, `Seilbahn`, and `téléphérique`. That filter is broad: it also captures tourist cable cars, toys, and unrelated projects, so relevance filtering is part of the challenge.[^seilbahn-readme]
The export is about 210 MB. It is kept in the local workspace but is **not tracked in git** because it exceeds common repository and hosting limits. The `resource` path above points to its expected local location.
# Schema
The file is a JSON array. Each record has the following fields:
| Field | Type | Description |
|---|---|---|
| `mention_id` | string | Provider-specific identifier for the mention. |
| `media_type_id` | integer | Numeric media type code. |
| `media_type_name` | string | Human-readable media type, for example `News`, `YouTube Video`, `Forums`, `Blog`, `Social Network`, `Microblog`. |
| `published_at` | string | Publication timestamp with UTC offset, for example `2025-05-10T18:05:00+0000`. |
| `source_name` | string | Domain or source name. |
| `url` | string | URL of the original content. |
| `country_code` | string or null | Two-letter country code where available. |
| `language_code` | string | Language code, for example `de`, `fr`, `en`. |
| `sentiment` | integer | Provider sentiment value: `1`, `0`, `-1`, or `-99`. |
| `reach` | integer or null | Estimated reach where available. |
| `engagements` | integer | Engagement count. |
| `authors` | array of strings | Author names or handles. |
| `title` | string | Title or headline. |
| `content` | string | Text content of the mention. |
# Coverage
| Metric | Value |
|---|---|
| Records | 39,361 |
| Date range | 2024-10-19T23:34:44Z to 2026-10-27T12:29:23Z |
| Records with a non-null reach | 28,805 |
| Total engagements | 1,308,843 |
| German-language records | 30,812 |
| French-language records | 7,999 |
| News records | 15,594 |
| Other media type | 9,061 |
| YouTube videos | 4,458 |
| Pictures | 3,799 |
| YouTube comments | 2,335 |
| Forums | 1,425 |
| Blogs | 977 |
| Comments | 892 |
| Social network posts | 454 |
| Microblog posts | 332 |
Sentiment value counts: `1` (20,712), `0` (9,928), `-99` (6,797), `-1` (1,924).
# Data quality notes
- **Not a survey.** The export reflects what media monitoring captured under a keyword filter, not a representative sample of the population. Report observed conversation, not population opinion.
- **Keyword noise.** `Seilbahn` and `téléphérique` capture mountain cable cars, toys, and unrelated content. `IPAI` may appear in unrelated contexts. Build and document a relevance classifier.
- **Sentiment sentinel.** `-99` is a distinct value and is most plausibly an unknown or unclassified marker. Do not average it as an extreme negative score without verifying its meaning.
- **Mixed languages.** German and French dominate, with smaller English, Hungarian, Spanish, and other groups. Normalise or stratify before comparing.
- **Media-type imbalance.** News dominates by volume, while social platforms may dominate engagement. Weight or separate the channels.
- **Missing reach.** About 10,500 records have no reach value. Do not treat missing reach as zero.
- **Possible duplicates.** The same article or post can appear through multiple sources or be reposted. Deduplicate by URL, title, and content similarity.
- **Content length varies.** Some records contain full articles, others only snippets. Text models should handle short and long inputs differently.
- **Author fields are lists.** A record can have zero, one, or several authors.
- **Privacy.** Although direct personal identifiers were removed, quoted content can still contain names. Avoid exposing personal information in a dashboard.[^seilbahn-readme]
# Example: load and profile
The file is about 210 MB. Loading it with the standard library is fine on a normal laptop, but stream it if memory is tight.
```python
import json
from collections import Counter
with open("Stadt Heilbronn/FSI_Heilbronn_Medienbeiträge (1).json", encoding="utf-8") as f:
records = json.load(f)
print(len(records))
print(Counter(r["media_type_name"] for r in records).most_common())
print(Counter(r["language_code"] for r in records).most_common(10))
print(Counter(r["sentiment"] for r in records))
```
# Questions the data can answer
- Which topics and arguments dominate the Heilbronn cable-car debate?
- How does stance differ between social media and news coverage?
- When did attention spike, and which real-world events coincide with the spikes?
- How does Heilbronn compare with Paris and Bonn?
- Is the cable car discussed differently from the IPAI campus?
# Sources
The README describes the collection rules, keyword filter, and intended analysis.[^seilbahn-readme] All counts and ranges above were computed from the delivered JSON export.
[^seilbahn-readme]: Stadt Heilbronn, "Riding the Sentiment: Exploring Public Opinion on Urban Cable Cars", challenge README, 2026.