Search for a specific SKU is missing a product

[OvalMedia]

Production-System:
Magento ver. 2.4.3-p1
Elasticsuite 2.10.23.2
Elasticsearch 7.10.2
PHP 7.4.33

Development-System:
Magento ver. 2.4.3-p1
Elasticsuite 2.10.23.2
Elasticsearch 7.8.1
PHP 7.4.33

I was just pointed to an issue with the search for an SKU ("CA-1"). Although the product exists and can be found through the categories, the search completely ignores this product.

To rule out magento issues I ran a query on the command line:
curl -X GET "http://localhost:9200/my_index/_search?q=CA-1&pretty"

I ran this on both my systems, dev and prod. While in production the product could not be found in my dev system it seems to be alright. (I wanted to paste both results here but github complained it would be too long).

Of course I have run indexer:reindex but that did not help at all.

This feels like something in the prod index is stuck and needs a reset or something?
How can I narrow this down so the product can be found?

Thank you

[romainruaud]

Hi @OvalMedia

please post the mapping of the two indices (dev/prod).

please ensure the product is found in both environment with the entity_id (?q=entity_id:xxx)

Regards

[OvalMedia]

curl -X GET "http://localhost:9200/my_index/_search?q=entity_id:6427&pretty"

Result on prod:

{
  "took" : 1,
  "timed_out" : false,
  "_shards" : {
    "total" : 1,
    "successful" : 1,
    "skipped" : 0,
    "failed" : 0
  },
  "hits" : {
    "total" : {
      "value" : 0,
      "relation" : "eq"
    },
    "max_score" : null,
    "hits" : [ ]
  }
}

On dev the result is actually a long one and it includes the product I am looking for.

Mapping on prod:

{

    "_category_name": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "addition": {
        "type": "integer"
    },
    "amount": {
        "type": "integer"
    },
    "application_polisher": {
        "type": "integer"
    },
    "attribute_set_id": {
        "type": "integer"
    },
    "autocomplete": {
        "type": "text",
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "analyzer": "standard"
    },
    "backingplate": {
        "type": "integer"
    },
    "capacity": {
        "type": "integer"
    },
    "category": {
        "type": "nested",
        "properties": {
            "category_id": {
                "type": "integer"
            },
            "category_uid": {
                "type": "text",
                "fields": {
                    "untouched": {
                        "type": "keyword",
                        "ignore_above": 256,
                        "normalizer": "untouched"
                    }
                },
                "norms": false,
                "analyzer": "keyword"
            },
            "is_blacklisted": {
                "type": "boolean"
            },
            "is_parent": {
                "type": "boolean"
            },
            "is_virtual": {
                "type": "boolean"
            },
            "name": {
                "type": "text",
                "fields": {
                    "standard": {
                        "type": "text",
                        "analyzer": "standard"
                    }
                },
                "copy_to": [
                    "search",
                    "spelling",
                    "_category_name"
                ],
                "norms": false,
                "analyzer": "keyword"
            },
            "position": {
                "type": "integer"
            }
        }
    },
    "children_attributes": {
        "type": "text",
        "fields": {
            "keyword": {
                "type": "keyword",
                "ignore_above": 256
            }
        }
    },
    "children_ids": {
        "type": "integer"
    },
    "cleaning_power": {
        "type": "integer"
    },
    "color": {
        "type": "integer"
    },
    "coloring_effect": {
        "type": "integer"
    },
    "configurable_attributes": {
        "type": "keyword"
    },
    "country_of_production": {
        "type": "integer"
    },
    "created_at": {
        "type": "date",
        "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd"
    },
    "cut": {
        "type": "integer"
    },
    "date_created": {
        "type": "date",
        "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd"
    },
    "diameter": {
        "type": "integer"
    },
    "drivemode": {
        "type": "integer"
    },
    "edge_ngram": {
        "type": "text",
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "standard_edge_ngram": {
                "type": "text",
                "analyzer": "standard_edge_ngram"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "analyzer": "standard"
    },
    "entity_id": {
        "type": "integer"
    },
    "filling_amount": {
        "type": "integer"
    },
    "gloss": {
        "type": "integer"
    },
    "grammage": {
        "type": "integer"
    },
    "hardness": {
        "type": "integer"
    },
    "has_options": {
        "type": "boolean"
    },
    "image": {
        "type": "text",
        "norms": false,
        "analyzer": "keyword"
    },
    "indexed_attributes": {
        "type": "keyword"
    },
    "manufacturer": {
        "type": "integer"
    },
    "material": {
        "type": "integer"
    },
    "meta_keyword": {
        "type": "text",
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "name": {
        "type": "text",
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "sortable": {
                "type": "text",
                "analyzer": "sortable",
                "fielddata": true
            },
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "nutzinhalt": {
        "type": "integer"
    },
    "operating_mode": {
        "type": "integer"
    },
    "option_text_addition": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_amount": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_application_polisher": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_backingplate": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_capacity": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_cleaning_power": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_color": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_coloring_effect": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_country_of_production": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_cut": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_diameter": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_drivemode": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_filling_amount": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_gloss": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_grammage": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_hardness": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_manufacturer": {
        "type": "text",
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_material": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_nutzinhalt": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_operating_mode": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_purpose": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_purpose_brushes": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_purpose_cleaner": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_purpose_detailer": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_purpose_pads": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_purpose_polish": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_purpose_shampoos": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_purpose_towels": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_sanding_grit": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_size": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_special_feature_towels": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_special_feature_wheelcleaner": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_status": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_stroke": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_tax_class_id": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_texture": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_type": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_type_glass": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_type_interior_plastic": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_type_leather": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_type_smell": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_type_sprayer": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_type_storage": {
        "type": "text",
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "norms": false,
        "analyzer": "keyword"
    },
    "option_text_visibility": {
        "type": "text",
        "norms": false,
        "analyzer": "keyword"
    },
    "price": {
        "type": "nested",
        "properties": {
            "customer_group_id": {
                "type": "integer"
            },
            "final_price": {
                "type": "double"
            },
            "is_discount": {
                "type": "boolean"
            },
            "max_price": {
                "type": "double"
            },
            "min_price": {
                "type": "double"
            },
            "original_price": {
                "type": "double"
            },
            "price": {
                "type": "double"
            },
            "tax_class_id": {
                "type": "integer"
            }
        }
    },
    "purpose": {
        "type": "integer"
    },
    "purpose_brushes": {
        "type": "integer"
    },
    "purpose_cleaner": {
        "type": "integer"
    },
    "purpose_detailer": {
        "type": "integer"
    },
    "purpose_pads": {
        "type": "integer"
    },
    "purpose_polish": {
        "type": "integer"
    },
    "purpose_shampoos": {
        "type": "integer"
    },
    "purpose_towels": {
        "type": "integer"
    },
    "ratings_summary": {
        "type": "double",
        "copy_to": [
            "search",
            "spelling"
        ]
    },
    "reference": {
        "type": "text",
        "fields": {
            "reference": {
                "type": "text",
                "analyzer": "reference"
            },
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "analyzer": "standard"
    },
    "required_options": {
        "type": "boolean"
    },
    "sanding_grit": {
        "type": "integer"
    },
    "search": {
        "type": "text",
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "analyzer": "standard"
    },
    "search_query": {
        "type": "nested",
        "properties": {
            "is_blacklisted": {
                "type": "boolean"
            },
            "position": {
                "type": "integer"
            },
            "query_id": {
                "type": "integer"
            }
        }
    },
    "short_description": {
        "type": "text",
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "size": {
        "type": "integer"
    },
    "sku": {
        "type": "text",
        "fields": {
            "reference": {
                "type": "text",
                "analyzer": "reference"
            },
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "sortable": {
                "type": "text",
                "analyzer": "sortable",
                "fielddata": true
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "copy_to": [
            "search",
            "spelling",
            "reference"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "special_feature_towels": {
        "type": "integer"
    },
    "special_feature_wheelcleaner": {
        "type": "integer"
    },
    "spelling": {
        "type": "text",
        "fields": {
            "phonetic": {
                "type": "text",
                "analyzer": "phonetic"
            },
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "analyzer": "standard"
    },
    "status": {
        "type": "integer"
    },
    "stock": {
        "properties": {
            "is_in_stock": {
                "type": "boolean"
            },
            "qty": {
                "type": "integer"
            }
        }
    },
    "stroke": {
        "type": "integer"
    },
    "tax_class_id": {
        "type": "integer"
    },
    "texture": {
        "type": "integer"
    },
    "type": {
        "type": "integer"
    },
    "type_glass": {
        "type": "integer"
    },
    "type_id": {
        "type": "keyword"
    },
    "type_interior_plastic": {
        "type": "integer"
    },
    "type_leather": {
        "type": "integer"
    },
    "type_smell": {
        "type": "integer"
    },
    "type_sprayer": {
        "type": "integer"
    },
    "type_storage": {
        "type": "integer"
    },
    "updated_at": {
        "type": "date",
        "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd"
    },
    "url_key": {
        "type": "text",
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "norms": false,
        "analyzer": "keyword"
    },
    "visibility": {
        "type": "integer"
    }
}

...and dev:

{

    "_category_name": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "addition": {
        "type": "integer"
    },
    "amount": {
        "type": "integer"
    },
    "application_polisher": {
        "type": "integer"
    },
    "attribute_set_id": {
        "type": "integer"
    },
    "autocomplete": {
        "type": "text",
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "analyzer": "standard"
    },
    "backingplate": {
        "type": "integer"
    },
    "capacity": {
        "type": "integer"
    },
    "category": {
        "type": "nested",
        "properties": {
            "category_id": {
                "type": "integer"
            },
            "category_uid": {
                "type": "text",
                "norms": false,
                "fields": {
                    "untouched": {
                        "type": "keyword",
                        "ignore_above": 256,
                        "normalizer": "untouched"
                    }
                },
                "analyzer": "keyword"
            },
            "is_blacklisted": {
                "type": "boolean"
            },
            "is_parent": {
                "type": "boolean"
            },
            "is_virtual": {
                "type": "boolean"
            },
            "name": {
                "type": "text",
                "norms": false,
                "fields": {
                    "standard": {
                        "type": "text",
                        "analyzer": "standard"
                    }
                },
                "copy_to": [
                    "search",
                    "spelling",
                    "_category_name"
                ],
                "analyzer": "keyword"
            },
            "position": {
                "type": "integer"
            }
        }
    },
    "children_attributes": {
        "type": "text",
        "fields": {
            "keyword": {
                "type": "keyword",
                "ignore_above": 256
            }
        }
    },
    "children_ids": {
        "type": "integer"
    },
    "cleaning_power": {
        "type": "integer"
    },
    "color": {
        "type": "integer"
    },
    "coloring_effect": {
        "type": "integer"
    },
    "configurable_attributes": {
        "type": "keyword"
    },
    "country_of_production": {
        "type": "integer"
    },
    "created_at": {
        "type": "date",
        "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd"
    },
    "cut": {
        "type": "integer"
    },
    "date_created": {
        "type": "date",
        "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd"
    },
    "diameter": {
        "type": "integer"
    },
    "drivemode": {
        "type": "integer"
    },
    "edge_ngram": {
        "type": "text",
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "standard_edge_ngram": {
                "type": "text",
                "analyzer": "standard_edge_ngram"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "analyzer": "standard"
    },
    "entity_id": {
        "type": "integer"
    },
    "filling_amount": {
        "type": "integer"
    },
    "gloss": {
        "type": "integer"
    },
    "grammage": {
        "type": "integer"
    },
    "hardness": {
        "type": "integer"
    },
    "has_options": {
        "type": "boolean"
    },
    "image": {
        "type": "text",
        "norms": false,
        "analyzer": "keyword"
    },
    "indexed_attributes": {
        "type": "keyword"
    },
    "manufacturer": {
        "type": "integer"
    },
    "material": {
        "type": "integer"
    },
    "meta_keyword": {
        "type": "text",
        "norms": false,
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "name": {
        "type": "text",
        "norms": false,
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "sortable": {
                "type": "text",
                "analyzer": "sortable",
                "fielddata": true
            },
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "nutzinhalt": {
        "type": "integer"
    },
    "operating_mode": {
        "type": "integer"
    },
    "option_text_addition": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_amount": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_application_polisher": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_backingplate": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_capacity": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_cleaning_power": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_color": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_coloring_effect": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_country_of_production": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_cut": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_diameter": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_drivemode": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_filling_amount": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_gloss": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_grammage": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_hardness": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_manufacturer": {
        "type": "text",
        "norms": false,
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_material": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_nutzinhalt": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_operating_mode": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_purpose": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_purpose_brushes": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_purpose_cleaner": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_purpose_detailer": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_purpose_pads": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_purpose_polish": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_purpose_shampoos": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_purpose_towels": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_sanding_grit": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_size": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_special_feature_towels": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_special_feature_wheelcleaner": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_status": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_stroke": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_tax_class_id": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_texture": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_type": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_type_glass": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "option_text_type_interior_plastic": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search"
        ],
        "analyzer": "keyword"
    },
    "option_text_type_leather": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search"
        ],
        "analyzer": "keyword"
    },
    "option_text_type_smell": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_type_sprayer": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_type_storage": {
        "type": "text",
        "norms": false,
        "fields": {
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "analyzer": "keyword"
    },
    "option_text_visibility": {
        "type": "text",
        "norms": false,
        "analyzer": "keyword"
    },
    "price": {
        "type": "nested",
        "properties": {
            "customer_group_id": {
                "type": "integer"
            },
            "final_price": {
                "type": "double"
            },
            "is_discount": {
                "type": "boolean"
            },
            "max_price": {
                "type": "double"
            },
            "min_price": {
                "type": "double"
            },
            "original_price": {
                "type": "double"
            },
            "price": {
                "type": "double"
            },
            "tax_class_id": {
                "type": "integer"
            }
        }
    },
    "purpose": {
        "type": "integer"
    },
    "purpose_brushes": {
        "type": "integer"
    },
    "purpose_cleaner": {
        "type": "integer"
    },
    "purpose_detailer": {
        "type": "integer"
    },
    "purpose_pads": {
        "type": "integer"
    },
    "purpose_polish": {
        "type": "integer"
    },
    "purpose_shampoos": {
        "type": "integer"
    },
    "purpose_towels": {
        "type": "integer"
    },
    "ratings_summary": {
        "type": "double",
        "copy_to": [
            "search",
            "spelling"
        ]
    },
    "reference": {
        "type": "text",
        "fields": {
            "reference": {
                "type": "text",
                "analyzer": "reference"
            },
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "analyzer": "standard"
    },
    "required_options": {
        "type": "boolean"
    },
    "sanding_grit": {
        "type": "integer"
    },
    "search": {
        "type": "text",
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "analyzer": "standard"
    },
    "search_query": {
        "type": "nested",
        "properties": {
            "is_blacklisted": {
                "type": "boolean"
            },
            "position": {
                "type": "integer"
            },
            "query_id": {
                "type": "integer"
            }
        }
    },
    "short_description": {
        "type": "text",
        "norms": false,
        "fields": {
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "size": {
        "type": "integer"
    },
    "sku": {
        "type": "text",
        "norms": false,
        "fields": {
            "reference": {
                "type": "text",
                "analyzer": "reference"
            },
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "sortable": {
                "type": "text",
                "analyzer": "sortable",
                "fielddata": true
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "copy_to": [
            "search",
            "spelling",
            "reference"
        ],
        "analyzer": "keyword"
    },
    "special_feature_towels": {
        "type": "integer"
    },
    "special_feature_wheelcleaner": {
        "type": "integer"
    },
    "spelling": {
        "type": "text",
        "fields": {
            "phonetic": {
                "type": "text",
                "analyzer": "phonetic"
            },
            "shingle": {
                "type": "text",
                "analyzer": "shingle"
            },
            "whitespace": {
                "type": "text",
                "analyzer": "whitespace"
            }
        },
        "analyzer": "standard"
    },
    "status": {
        "type": "integer"
    },
    "stock": {
        "properties": {
            "is_in_stock": {
                "type": "boolean"
            },
            "qty": {
                "type": "integer"
            }
        }
    },
    "stroke": {
        "type": "integer"
    },
    "tax_class_id": {
        "type": "integer"
    },
    "texture": {
        "type": "integer"
    },
    "type": {
        "type": "integer"
    },
    "type_glass": {
        "type": "integer"
    },
    "type_id": {
        "type": "keyword"
    },
    "type_interior_plastic": {
        "type": "integer"
    },
    "type_leather": {
        "type": "integer"
    },
    "type_smell": {
        "type": "integer"
    },
    "type_sprayer": {
        "type": "integer"
    },
    "type_storage": {
        "type": "integer"
    },
    "updated_at": {
        "type": "date",
        "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd"
    },
    "url_key": {
        "type": "text",
        "norms": false,
        "fields": {
            "standard": {
                "type": "text",
                "analyzer": "standard"
            },
            "untouched": {
                "type": "keyword",
                "ignore_above": 256,
                "normalizer": "untouched"
            }
        },
        "copy_to": [
            "search",
            "spelling"
        ],
        "analyzer": "keyword"
    },
    "visibility": {
        "type": "integer"
    }

}

[rbayet]

Hello @OvalMedia,

If the ID of the product is expected to be the same on both environment, then it looks like the product might be simply missing from the index because it has been disabled.

Regards,

[OvalMedia]

Yes, it is missing. But why? And how do I fix it? Both systems are identical except for the versions mentioned above.
Would it make sense to somehow rebuild the index? I don't know how deep a simple "indexer:reindex" is going. Is there anything else I can do?

[OvalMedia]

Is there a way to check why a product is missing or to reset the index somehow?

[OvalMedia]

I tried curl -X DELETE "http://localhost:9200/my_index_name" followed by a indexer:reindex. No change.

[rbayet]

Hello @OvalMedia,

A php bin/magento indexer:reindex catalogsearch_fulltext will force a full reindex of your catalog_product Elasticsuite indices and, depending on the state of the stock and prices indexers, will force a re-index of those too (if they are in "invalid / need re-indexing" state).

As a general rule, for a product to be indexed and/or visible in a store, it needs to

• be assigned to the website
• be enabled for the store view
• be located in at least one category of the store the store view belongs to
• have a price
• be in stock depending on the store configuration for hiding or showing products out of stock
• have its visibility different than "not visible individually" for the store (so either visibility "Catalog" = will not be shown in search, or "Search" = will not be visible in categories product list or "Catalog/Search" = will be visible in both contexts)

So if the problem is limited to only one product, you could get away with verifying all those, save the product in Magento admin and wait for the diff indexing to push the product.

Regards,

[OvalMedia]

Thx. At this point we created a new product and copied over all the data and the product reappeared. Must be something with that particular entity that is messed up. In case I missed to mention it: the detail page of the product was fine and the product could be ordered. Just catalog and search were not working.
Now the customer is reporting another product gone missing. Of course it is not a very reassuring feeling that products may or may not be available in the catalog.
I am not asking for you to solve my problem but rather assist on how I can verify or falsify this problem. E.g. would there be a SQL query that could give me a list of products that are not properly indexed?

[OvalMedia]

Is there a way to identify products that, for some reason, do not end up in the index?
I was reported another product that is gone missing after it has been modified in the backend.

[OvalMedia]

I get this error in the system.log after saving a missing product in the backend:
main.ERROR: Bulk index operation failed 1 times in my_index for type _doc. Error (mapper_parsing_exception) : failed to parse field [created_at] of type [date] in document with id '5626'. Preview of field's value: '0000-00-00 00:00:00'. Failed doc ids sample : 5626. [] []

[vahonc]

Hello @OvalMedia,

It looks like, Elasticsearch rejected the document with id 5626 from being indexed due to invalid data or incorrect format of the date. This error occurs because the created_at field for the product has an invalid value. Magento sometimes stores 0000-00-00 00:00:00 as a default value for created_at or updated_at fields when no valid date is provided. Elasticsearch enforces strict validation based on its mappings. If the data sent by Magento does not conform to the mapping, Elasticsearch will reject the document. ElasticSuite takes the data from Magento's database and sends it to Elasticsearch during indexing. If a field has an invalid value, it causes an indexing failure like the one you see.

Have you checked the data in the database for your problematic product?

BR,
Vadym

[OvalMedia]

Ok, we are getting closer. I checked the table catalog_product_entity and it turns out that the value for created_at on the problematic products is actually 0000-00-00 00:00:00 (like stated in the error message). Setting that value manually to something meaningful fixes the issue. Now I need to find out why some products don't have a created_at date.

[vahonc]

Maybe this is related to some product imports?

[OvalMedia]

A custom module's plugin beforeGetCreatedAt had set the created_at field conditionally from another date field. In some rare cases this turned out to be null.

This module has been around since forever. Why it just started making trouble is beyond me. A couple of weeks ago we updated to the latest version of ESS, maybe something changed there?

Anyhow, problem is fixed. Thanks for your time.