Research prototype · Master's thesis

How does ChatGPT describe your company?

Sembrelio asks ChatGPT questions as potential customers would, and compares the statements about your business with the facts from your questionnaire and your website.

Request a free assessment How we measure

About 10 minutes of your time
Every report reviewed by a person
Free of charge

Assessment · Musterfirma GmbHExample, fictitious values

Visibility: 3 / 9 answers; of 9 general answers that name at least one provider or platform
Accuracy: 38 / 44 statements
Not verifiable: 14 / 58 statements
Coverage: 12 / 30 facts

Incorrect

ChatGPT names an outdated location and lists a discontinued product as part of the current range.

Process

Three steps to your report

Complete the questionnaire
You describe your business and what you offer. Together with your website, this is the reference for the check.
Measurement
Each assessment uses 20 questions. A person reviews the questions before they are sent to the AI service. The question set is then frozen and not changed.
Receive the report
You see whether your business is named, which statements are correct or incorrect, which facts are missing, which sources are cited and which other providers ChatGPT names in general questions about your industry.

Metrics

Four figures, each with numerator and denominator

Every figure is shown with its numerator and denominator, not only as a percentage.

How we measure

Visibility: Answers to the questions without your business name that name your business, divided by all of these answers that name at least one provider or platform.
Factual accuracy: Correct statements divided by all checked statements (correct and incorrect).
Not verifiable: Statements that cannot be verified are shown separately.
Coverage: Expected facts stated correctly divided by all expected facts.

For industrial SMEs

What does ChatGPT answer when asked for providers?

AI assistants also answer questions about suppliers and providers. A business usually does not see these answers.

The assessment shows what ChatGPT says about your business at the time of measurement. It is a snapshot and makes no statement about future visibility, revenue or customer numbers.

Research project

Sembrelio is a research prototype developed as part of a master's thesis at Frankfurt School. Your data is used for research only with your separate consent, and only in pseudonymised form.

Open method

We measure through the official OpenAI API with web search. This is an approximation of ChatGPT, not a replica of the ChatGPT app. The limitations are listed on the method page.

Your data

You can withdraw your research consent at any time and request deletion of your data. Details in the privacy notice.

Who is behind this

Sembrelio is a research project by Faith Katingi, Ekaterina Kuznetsova and Thomas Hilbig as part of their master's thesis at Frankfurt School of Finance & Management.

Who we are