SE-06: Restaurants and Gastronomy
ICO Std 2002 — Extension SE-06
This extension module specifies the methodology requirements for ranking and evaluating restaurants, chefs, and gastronomic experiences. It draws upon the methodological foundations established in the core layer (Chapters 4–10) and adapts them to the particularities of culinary assessment, where subjective sensory experience, cultural context, and consistency over time are paramount. The module addresses the design of evaluation criteria, the governance of inspection and review processes, and the protection of gastronomic cultural diversity.
SE-6.1 Scope and Applicable Objects
SE-6.1.1 Scope
This module shall apply to the design, execution, and governance of ranking systems that evaluate:
a) individual restaurants, including single-location and multi-location establishments;
b) chefs and culinary professionals, assessed on creative output and technical mastery;
c) gastronomic traditions and regional cuisines, assessed on cultural significance and preservation vitality;
d) food and beverage products, assessed on quality, provenance, and production method;
e) culinary destinations, assessed on the density, diversity, and quality of gastronomic offerings.
SE-6.1.2 Normative References
The following references shall inform the design of restaurant ranking methodologies:
- ISO 21469:2024 Sensory analysis General guidance for the design of tests
- Michelin Guide methodology anonymous inspection, multiple visits, collegial deliberation
- The World’s 50 Best Restaurants voting academy structure and audit procedures
- UNESCO Convention for the Safeguarding of the Intangible Cultural Heritage (2003) gastronomic traditions as living heritage
SE-6.1.3 Relationship to Core Layer
This module shall conform to the core layer as follows:
a) Chapter 4 (Principles): All core principles, including independence, transparency, and fairness, shall apply. The requirement for independence is especially critical given the commercial sensitivity of restaurant ratings.
b) Chapter 5 (Indicator Design): Indicators shall follow the selection criteria (relevance, measurability, data availability, independence, timeliness).
c) Chapter 8 (Scoring and Ranking): The scoring model shall be documented with weighting rationale, and the ranking method shall be specified.
d) Chapter 10 (Audit and Traceability): Inspection records shall be retained for audit, and reviewer identity shall be protected.
SE-6.2 Indicator System
SE-6.2.1 Indicator Hierarchy
The indicator system for restaurant evaluation shall comprise two tiers of indicators:
Core Indicators (primary determinants of ranking)
| Code | Indicator | Weight Range | |
|---|---|---|---|
| SE-6.2.1.1 | Food Quality | 40 %–60 % | |
| SE-6.2.1.2 | Culinary Technique & Mastery | 15 %–25 % | |
| SE-6.2.1.3 | Ingredient Quality & Sourcing | 10 %–20 % |
Auxiliary Indicators (contextual modifiers)
| Code | Indicator | Weight Range | |
|---|---|---|---|
| SE-6.2.1.4 | Service & Hospitality | 5 %–15 % | |
| SE-6.2.1.5 | Ambiance & Atmosphere | 5 %–10 % | |
| SE-6.2.1.6 | Value for Money | 0 %–10 % | |
| SE-6.2.1.7 | Consistency Over Time | mandatory modifier |
The sum of weights for core indicators shall be no less than 60 % of the total score. Food quality (SE-6.2.1.1) shall always carry the highest individual weight.
SE-6.2.2 Food Quality (SE-6.2.1.1)
Food quality shall be assessed through the following sub-indicators:
a) Flavor balance and harmony — The integration of taste components (sweet, sour, salty, bitter, umami) shall be evaluated for balance, depth, and complexity. Each dish shall be assessed individually, and the overall menu coherence shall also be considered.
b) Texture and mouthfeel — The range and appropriateness of textures within and across dishes shall be evaluated. Technical execution of intended textures (crisp, tender, gelatinous, etc.) shall be assessed.
c) Presentation and visual appeal — The visual composition of dishes shall be assessed as it contributes to the dining experience, but shall not dominate the overall food quality score. The weight of presentation within food quality shall not exceed 15 %.
d) Creativity and originality — The degree of culinary innovation, while respecting culinary tradition, shall be assessed. Originality without technical execution shall not receive high scores.
SE-6.2.3 Culinary Technique & Mastery (SE-6.2.1.2)
a) Technical precision in execution — doneness, seasoning accuracy, sauce consistency — shall be the primary basis for scoring.
b) Range of techniques employed — classical, modern, and innovative techniques — shall be documented but shall not alone determine the score; mastery of fewer techniques may score higher than superficial use of many.
c) The ranking entity should provide technique assessment guidelines calibrated to the cuisine tradition being evaluated (e.g., wok hei in Cantonese cuisine, fermentation control in Japanese cuisine).
SE-6.2.4 Ingredient Quality & Sourcing (SE-6.2.1.3)
a) Provenance and traceability of key ingredients shall be verified where claimed. Restaurants making origin claims (e.g., PDO, AOC, GI-certified ingredients) shall provide documentation upon inspection.
b) Seasonality and locality of ingredient selection should be recognized as positive attributes where relevant to the culinary tradition.
c) The ranking entity shall not mandate any specific sourcing philosophy (e.g., local-only, organic-only) but shall evaluate ingredient quality on its merits as reflected in the final dish.
SE-6.2.5 Consistency Over Time (SE-6.2.1.7)
Consistency shall be evaluated as a mandatory modifier, not as a standalone indicator:
a) A minimum of two (2) inspection visits at different times shall be required for any restaurant to be included in a ranking. Visits shall be separated by at least 30 calendar days.
b) The ranking entity should require three (3) or more visits for higher-tier ratings (e.g., equivalent to two-star or three-star designations).
c) Consistency shall be assessed across: 1) quality of signature dishes across visits; 2) overall menu standard maintenance; 3) service standard maintenance; 4) consistency of the dining experience from start to finish of each visit.
d) Significant inconsistency across visits shall result in a downgrade modifier applied to the aggregate score, with the magnitude of the modifier proportional to the degree of inconsistency.
SE-6.3 Reviewer System
SE-6.3.1 Reviewer Qualifications
a) Inspectors shall possess a minimum of five (5) years of professional experience in culinary evaluation, food criticism, or fine dining service.
b) Inspectors shall undergo calibration training before each evaluation cycle. Calibration shall include: 1) blind tasting of reference dishes with known quality levels; 2) written evaluation of sample meals compared to benchmark scores; 3) inter-rater reliability testing (Cohen’s κ ≥ 0.70 for core indicators).
c) Inspectors shall maintain continuing education in culinary trends, emerging cuisines, and evaluation methodology, with a minimum of 20 hours per year.
SE-6.3.2 Anonymity and Independence
a) Inspectors shall dine anonymously. The ranking entity shall implement procedures to prevent identification, including: 1) use of reservations under varied names; 2) payment by methods not traceable to the ranking entity; 3) avoidance of identifiable behavior (e.g., photographing every course, taking notes at table).
b) Inspectors shall not accept hospitality, discounts, or preferential treatment from restaurants under evaluation. All expenses shall be reimbursed by the ranking entity at full published price.
c) Inspectors shall declare any conflict of interest, including personal relationships with restaurant owners or chefs, prior financial interests, and prior consulting engagements. A declared conflict shall result in reassignment of the inspection.
SE-6.3.3 Multiple Visit Protocol
a) Each visit shall vary the dining context to assess consistency across: 1) different days of the week (weekday vs. weekend); 2) different times of day (lunch vs. dinner, where both are offered); 3) different party sizes (solo, couple, group); 4) seasonal menu variation.
b) At least one visit per restaurant shall include ordering the à la carte menu in its entirety or a representative cross-section. Tasting menus may be evaluated on separate visits.
c) Visit reports shall be completed within 48 hours of the inspection and shall include detailed dish-by-dish evaluations, not merely an overall impression.
SE-6.3.4 Collegial Deliberation
a) Final ratings shall not be determined by a single inspector. A panel of no fewer than three (3) inspectors who have visited the restaurant shall deliberate to reach a consensus or a documented vote.
b) Deliberation shall consider all visit reports, address discrepancies between inspectors, and document the rationale for the final rating.
c) Where consensus cannot be reached, the median score of the panel shall be adopted, with dissenting opinions recorded.
SE-6.4 Scoring Model
SE-6.4.1 Scoring Scale
a) Each core and auxiliary indicator shall be scored on a 0–20 integer scale, where:
| Score | Description | |
|---|---|---|
| 18–20 | Exceptional — among the very best examples globally | |
| 15–17 | Excellent — outstanding with minor imperfections | |
| 12–14 | Very Good — high quality, professionally executed | |
| 9–11 | Good — competent, with noticeable limitations | |
| 6–8 | Fair — adequate but undistinguished | |
| 3–5 | Poor — below standard for the category | |
| 0–2 | Unacceptable — fundamental failures |
b) The aggregate score S shall be computed as:
S = Σ(wᵢ · sᵢ · C)
where wᵢ is the weight of indicator i, sᵢ is the raw score, and C is the consistency modifier (0.85 ≤ C ≤ 1.10), with C < 1.0 for inconsistent performance and C > 1.0 only in cases of exceptional consistency across three or more visits.
SE-6.4.2 Tier Classification
a) Restaurants shall be classified into tiers based on aggregate scores:
| Tier | Aggregate Score | Designation | |
|---|---|---|---|
| Tier 1 | ≥ 17.0 | Exceptional | |
| Tier 2 | 14.0 – 16.9 | Excellent | |
| Tier 3 | 11.0 – 13.9 | Very Good | |
| Tier 4 | 8.0 – 10.9 | Good | |
| Tier 5 | < 8.0 | Not Ranked |
b) Tier boundaries may be adjusted by the ranking entity to reflect the distribution of scores in a given evaluation cycle, provided that such adjustments are documented and disclosed in the methodology report.
SE-6.4.3 Cuisine-Specific Calibration
a) The ranking entity shall define cuisine categories and shall ensure that scoring accounts for the intrinsic standards and aspirations of each cuisine tradition.
b) Cross-cuisine comparison shall be conducted only at the level of universal criteria (technical execution, ingredient quality, consistency). Cuisine-specific criteria (e.g., authenticity to tradition, innovation within tradition) shall be evaluated within their respective categories.
c) The ranking entity should not privilege any cuisine tradition over another in the overall methodology design. Cultural bias shall be mitigated through diverse reviewer composition and cuisine-specific calibration.
SE-6.5 Gastronomic Cultural Diversity Protection
SE-6.5.1 Diversity Principle
a) The ranking methodology shall be designed to recognize and reward culinary diversity, not merely converge on a single standard of excellence. Different culinary traditions embody different values and aesthetics that shall be respected.
b) The ranking entity should include categories or sub-rankings that ensure visibility for: 1) underrepresented or endangered culinary traditions; 2) regional cuisines with limited international exposure; 3) traditional and indigenous foodways.
c) The methodology shall not penalize restaurants for adhering to traditional methods that do not conform to contemporary fine-dining conventions.
SE-6.5.2 Intangible Heritage Recognition
a) Restaurants or culinary practices recognized as intangible cultural heritage by UNESCO or national heritage bodies shall be flagged in the ranking with a heritage designation, independent of their numerical score.
b) Heritage designation shall be factual and based on official recognition status only. The ranking entity shall not make independent heritage assessments.
SE-6.5.3 Anti-Homogenization Measures
a) The ranking entity shall monitor for rating homogenization — the phenomenon whereby restaurants converge on a single style to optimize for rating criteria. Indicators of homogenization include: 1) increasing similarity in menu structure and presentation across ranked restaurants; 2) declining representation of diverse culinary traditions in upper tiers; 3) declining scores for authenticity and tradition-adherence over time.
b) Where homogenization is detected, the ranking entity should recalibrate weights to increase the value of diversity-related indicators.
SE-6.6 Benchmarking and External Alignment
SE-6.6.1 Michelin Guide Alignment
The ranking methodology should be informed by the Michelin Guide’s core principles, which this standard acknowledges as a widely referenced precedent:
a) Five criteria: quality of ingredients, mastery of flavor and cooking techniques, the personality of the chef in the cuisine, value for money, and consistency between visits.
b) Anonymous, independent inspection paid for by the ranking entity.
c) Decisions made by collegial consensus, not individual inspectors.
Note: Direct alignment with Michelin’s proprietary methodology is not possible due to its non-public nature. This standard establishes independently auditable criteria that reflect the same principles.
SE-6.6.2 World’s 50 Best Alignment
a) Where the ranking methodology incorporates voting-academy elements, the ranking entity shall document: 1) the composition and geographic distribution of the voting panel; 2) the rules for vote allocation and rotation; 3) the procedures for preventing coordinated voting and self-interest.
b) The ranking entity should implement an independent audit of the voting process, analogous to the procedures used by the World’s 50 Best organization.
SE-6.7 Data Collection and Verification
SE-6.7.1 Primary Data
a) All primary evaluations shall be based on direct, first-hand dining experience by qualified inspectors. Desk research, media reports, or public reviews shall not substitute for on-site inspection.
b) Inspection data shall include, at minimum: 1) date, time, and duration of each visit; 2) dishes ordered and their individual scores; 3) total cost and per-cover cost; 4) narrative assessment for each indicator; 5) any deviations from standard service or product that affected the evaluation.
SE-6.7.2 Secondary Data
a) Secondary data sources may supplement but shall not replace primary inspection data. Permissible secondary sources include: 1) verified food safety and hygiene ratings from regulatory authorities; 2) ingredient provenance certifications (PDO, GI, organic); 3) chef credentials and competition records; 4) customer satisfaction data from independent surveys (with documented methodology).
b) The ranking entity shall assign a documented reliability weight to each secondary data source, with a maximum reliability weight of 0.30 for any single secondary source.
SE-6.8 Publication and Transparency
SE-6.8.1 Methodology Disclosure
a) The ranking entity shall publish a complete methodology document including all indicators, weights, scoring scales, reviewer qualification requirements, and visit protocols.
b) Indicator weights shall be disclosed. Exact weighting values may be presented as ranges if the ranking entity determines that precise disclosure would enable gaming, provided the ranges are no wider than ±5 percentage points from the actual value.
c) The number of inspections conducted for each ranked restaurant shall be disclosed.
SE-6.8.2 Reviewer Identity Protection
a) The identities of individual inspectors shall not be disclosed to the public or to restaurants under evaluation.
b) The ranking entity shall publish the number of inspectors, their general qualification profile, and the geographic distribution of the inspector corps, without identifying individuals.
c) Internal records linking inspector identities to specific visits shall be retained for audit purposes in accordance with Chapter 10 but shall not be published.
Note: This extension module is part of ICO Std 2002 (Tianji Ranking Methodology Standard). It provides sector-specific requirements that supplement, but do not override, the core layer. Where conflict arises between this module and the core layer, the core layer shall prevail. Implementation of this module shall be validated by the SE-06 Working Group with participation from culinary professionals, cultural heritage experts, and methodology specialists.