Service Design Specification
ebaycclone-searchindexing-service documentation
-Version:1.0.0
Scope
This document provides a structured architectural overview of the
searchIndexing
microservice, detailing its configuration, data model,
authorization logic, business rules, and API design. It has been
automatically generated based on the service definition within
Mindbricks, ensuring that the information reflects the source of
truth used during code generation and deployment.
The document is intended to serve multiple audiences:
- Service architects can use it to validate design decisions and ensure alignment with broader architectural goals.
- Developers and maintainers will find it useful for understanding the structure and behavior of the service, facilitating easier debugging, feature extension, and integration with other systems.
- Stakeholders and reviewers can use it to gain a clear understanding of the service's capabilities and domain logic.
Note for Frontend Developers: While this document is valuable for understanding business logic and data interactions, please refer to the Service API Documentation for endpoint-level specifications and integration details.
Note for Backend Developers: Since the code for this service is automatically generated by Mindbricks, you typically won't need to implement or modify it manually. However, this document is especially valuable when you're building other services—whether within Mindbricks or externally—that need to interact with or depend on this service. It provides a clear reference to the service's data contracts, business rules, and API structure, helping ensure compatibility and correct integration.
SearchIndexing
Service Settings
Edit
Maintains the denormalized search index (materialized view) for global, public search across products, sellers, categories, and subcategories. Handles indexing in response to entity events and exposes optimized query endpoints for BFF/aggregator.
Service Overview
This service is configured to listen for HTTP requests on port
3008, serving both the main API interface and default administrative
endpoints.
The following routes are available by default:
-
API Test Interface (API Face):
/ -
Swagger Documentation:
/swagger -
Postman Collection Download:
/getPostmanCollection -
Health Checks:
/healthand/admin/health -
Current Session Info:
/currentuser -
Favicon:
/favicon.ico
The service uses a PostgreSQL database for data
storage, with the database name set to
ebaycclone-searchindexing-service.
This service is accessible via the following environment-specific URLs:
-
Preview:
https://ebaycclone.prw.mindbricks.com/searchindexing-api -
Staging:
https://ebaycclone-stage.mindbricks.co/searchindexing-api -
Production:
https://ebaycclone.mindbricks.co/searchindexing-api
Authentication & Security
- Login Required: Yes
This service requires user authentication for access. It supports both JWT and RSA-based authentication mechanisms, ensuring secure user sessions and data integrity. If a crud route also is configured to require login, it will check a valid JWT token in the request query/header/bearer/cookie. If the token is valid, it will extract the user information from the token and make the fetched session data available in the request context.
Service Data Objects
The service uses a PostgreSQL database for data
storage, with the database name set to
ebaycclone-searchindexing-service.
Data deletion is managed using a
soft delete strategy. Instead of removing records
from the database, they are flagged as inactive by setting the
isActive
field to
false.
| Object Name | Description | Public Access |
|---|---|---|
searchIndex
|
Materialized/denormalized search index record for a marketplace entity (product, seller, category, subcategory). Used exclusively for high-speed querying in BFF global/public search. | accessProtected |
searchIndex Data Object
Object Overview
Description: Materialized/denormalized search index record for a marketplace entity (product, seller, category, subcategory). Used exclusively for high-speed querying in BFF global/public search.
This object represents a core data structure within the service
and acts as the blueprint for database interaction, API
generation, and business logic enforcement. It is defined using
the
ObjectSettings
pattern, which governs its behavior, access control, caching
strategy, and integration points with other systems such as Stripe
and Redis.
Core Configuration
-
Soft Delete: Enabled — Determines whether
records are marked inactive (
isActive = false) instead of being physically deleted. - Public Access: accessProtected — If enabled, anonymous users may access this object’s data depending on API-level rules.
Composite Indexes
- searchIndex_type_refid_unique: [documentType, referenceId] This composite index is defined to optimize query performance for complex queries involving multiple fields.
The index also defines a conflict resolution strategy for duplicate key violations.
When a new record would violate this composite index, the following action will be taken:
On Duplicate:
doUpdate
The existing record will be updated with the new data.No error will be thrown.
Properties Schema
| Property | Type | Required | Description |
|---|---|---|---|
documentType
|
Enum | Yes | Type of the indexed document: PRODUCT, SELLER, CATEGORY, SUBCATEGORY |
document
|
Object | Yes | Denormalized snapshot of the entity data, optimized for full-text search. May contain different keys depending on documentType. |
referenceId
|
ID | Yes | ID of the underlying source entity (product, seller, category, subcategory) for reverse-mapping/database triggers. |
indexedAt
|
Date | Yes | Timestamp when the record was (last) indexed. Used for maintenance, debugging, rebuild tracing. |
- Required properties are mandatory for creating objects and must be provided in the request body if no default value is set.
Default Values
Default values are automatically assigned to properties when a new object is created, if no value is provided in the request body. Since default values are applied on db level, they should be literal values, not expressions.If you want to use expressions, you can use transposed parameters in any business API to set default values dynamically.
- documentType: "PRODUCT"
- document: {}
- referenceId: '00000000-0000-0000-0000-000000000000'
- indexedAt: new Date()
Auto Update Properties
documentType
document
referenceId
indexedAt
An update crud API created with the option
Auto Params
enabled will automatically update these properties with the
provided values in the request body. If you want to update any
property in your own business logic not by user input, you can set
the
Allow Auto Update
option to false. These properties will be added to the update
API's body parameters and can be updated by the user if any value
is provided in the request body.
Enum Properties
Enum properties are defined with a set of allowed values, ensuring that only valid options can be assigned to them. The enum options value will be stored as strings in the database, but when a data object is created an addtional property with the same name plus an idx suffix will be created, which will hold the index of the selected enum option. You can use the index property to sort by the enum value or when your enum options represent a sequence of values.
- documentType: [PRODUCT, SELLER, CATEGORY, SUBCATEGORY]
Elastic Search Indexing
documentType
document
referenceId
indexedAt
Properties that are indexed in Elastic Search will be searchable via the Elastic Search API. While all properties are stored in the elastic search index of the data object, only those marked for Elastic Search indexing will be available for search queries.
Database Indexing
documentType
referenceId
indexedAt
Properties that are indexed in the database will be optimized for query performance, allowing for faster data retrieval. Make a property indexed in the database if you want to use it frequently in query filters or sorting.
Cache Select Properties
referenceId
Cache select properties are used to collect data from Redis entity cache with a different key than the data object id. This allows you to cache data that is not directly related to the data object id, but a frequently used filter.
Secondary Key Properties
referenceId
Secondary key properties are used to create an additional indexed identifiers for the data object, allowing for alternative access patterns. Different than normal indexed properties, secondary keys will act as primary keys and Mindbricks will provide automatic secondary key db utility functions to access the data object by the secondary key.
Filter Properties
documentType
referenceId
indexedAt
Filter properties are used to define parameters that can be used in query filters, allowing for dynamic data retrieval based on user input or predefined criteria. These properties are automatically mapped as API parameters in the listing API's that have "Auto Params" enabled.
-
documentType: Enum has a filter named
documentType -
referenceId: ID has a filter named
referenceId -
indexedAt: Date has a filter named
indexedAt
Business Logic
searchIndexing has got 5 Business APIs to manage its internal and crud logic. For the details of each business API refer to its chapter.
Edge Controllers
rebuildSearchIndex
Configuration:
-
Function Name:
rebuildSearchIndex - Login Required: Yes
REST Settings:
-
Path:
/admin/rebuild-search-index - Method:
Service Library
Functions
No general functions defined.
Hook Functions
No hook functions defined.
Edge Functions
rebuildSearchIndex.js
// Admin/automation function to force full index regeneration for all materialized types.
module.exports = async (request) => {
// Example: Get all products, sellers, categories, subcategories (from upstream APIs).
// For each, denormalize data and write as a searchIndex (upsert by (documentType, referenceId)).
// Set indexedAt to now for each.
// Details of fetching entities and document transformation are handled externally.
return { status: 200, message: "Reindex triggered. Actual rebuild will be handled by backend process queue." };
};
Templates
No templates defined.
Assets
No assets defined.
Public Assets
No public assets defined.
Event Emission
Integration Patterns
Deployment Considerations
Environment Configuration
-
HTTP Port:
3008 - Database Type: MongoDB
- Global Soft Delete: Enabled
Implementation Guidelines
Development Workflow
- Data Model Implementation: Generate database schema from data object definitions
- CRUD Route Generation: Implement auto-generated routes with custom logic
- Custom Logic Integration: Implement hook functions and edge functions
- Authentication Integration: Configure with project-level authentication
- Testing: Unit and integration testing for all components
Code Generation Expectations
- Database Schema: Auto-generated from data objects and relationships
- API Routes: REST endpoints with customizable behavior
- Validation Logic: Input validation from property definitions
- Access Control: Authentication and authorization middleware
Custom Code Integration Points
- Hook Functions: Lifecycle-specific custom logic
- Edge Functions: Full request/response control
- Library Functions: Reusable business logic
- Templates: Dynamic content rendering
Testing Strategy
Unit Testing
- Test all custom library functions
- Test validation logic and business rules
- Test hook function implementations
Integration Testing
- Test API endpoints with authentication scenarios
- Test database operations and transactions
- Test external integrations
- Test event emission and Kafka integration
Performance Testing
- Load test high-traffic endpoints
- Test caching effectiveness
- Monitor database query performance
- Test scalability under load
Appendices
Data Type Reference
| Type | Description | Storage |
|---|---|---|
| ID | Unique identifier | UUID (SQL) / ObjectID (NoSQL) |
| String | Short text (≤255 chars) | VARCHAR |
| Text | Long-form text | TEXT |
| Integer | 32-bit whole numbers | INT |
| Boolean | True/false values | BOOLEAN |
| Double | 64-bit floating point | DOUBLE |
| Float | 32-bit floating point | FLOAT |
| Short | 16-bit integers | SMALLINT |
| Object | JSON object | JSONB (PostgreSQL) / Object (MongoDB) |
| Date | ISO 8601 timestamp | TIMESTAMP |
| Enum | Fixed numeric values | SMALLINT with lookup |
Enum Value Mappings
Request Locations
-
0: Bearer token in Authorization header -
1: Cookie value -
2: Custom HTTP header -
3: Query parameter -
4: Request body property -
5: URL path parameter -
6: Session data -
7: Root request object
HTTP Methods
-
0: GET -
1: POST -
2: PUT -
3: PATCH -
4: DELETE
Edge Function Signature
async function edgeFunction(request) {
// Custom request processing
// Return response object or throw error
return {
data: {},
status: 200,
message: "Success"
};
}
This document was generated from the service architecture definition and should be kept in sync with implementation changes.