Repository navigation

Add Search API with OpenSearch Domain and VPC Resources - #1219

Merged

isabeleliassen merged 137 commits into

csg-org:mainfrom

InspiringApps:feat/add-vpc

Dec 29, 2025

Merged

Add Search API with OpenSearch Domain and VPC Resources#1219
isabeleliassen merged 137 commits into
csg-org:mainfrom
InspiringApps:feat/add-vpc

Commits on Dec 2, 2025
- Add VPC stack with tests
  Landon Shumway
  committed
  e968b41
- PR feedback
  Landon Shumway
  committed
  c7a6fd0
- Add encryption to VPC flow logs
  Landon Shumway
  committed
  100b125
- PR feedback - fix docs
  Landon Shumway
  committed
  3d4054a
- Add search persistent stack with OpenSearch Domain
  Landon Shumway
  committed
  f513430
- remove 'beta release' from the IT docs
  Landon Shumway
  committed
  90b57f8
- Set explicit CIDR blocks
  Landon Shumway
  committed
  6097f5c
- Set explicit subnet for non-prod OpenSearch domain
  Landon Shumway
  committed
  d72fea4
- Fix cloudwatch policy
  Landon Shumway
  committed
  fad5fb0
- Add alarms for domain monitoring
  Landon Shumway
  committed
  7c6fb81
- Tweak alarms thresholds
  Landon Shumway
  committed
  e1bcd0e
- Add advanced option to prevent specifying index in queries for security
  Landon Shumway
  committed
  ae50c5a
- Add custom resource to manage OpenSearch indices
  Landon Shumway
  committed
  5bfbfde
- Add requirements for search lambda directory
  Landon Shumway
  committed
  9028af0
- Add domain access policy to restrict access to lambda roles
  Landon Shumway
  committed
  56f6ff8
- formatting
  Landon Shumway
  committed
  2d066ce
- apply vpc policy to all lambdas
  Landon Shumway
  committed
  8c143b4
- PR feedback
  Landon Shumway
  committed
  f411f6d
- Add needed nag suppressions
  Landon Shumway
  committed
  a30147c
- Use custom analyzer to support ascii folding in name searches
  Landon Shumway
  committed
  7bd9344
- Add needed HEAD permission for checking if an index exists
  Landon Shumway
  committed
  4078df0
- Add HEAD permission to access policy for search lambda role
  Landon Shumway
  committed
  4dc665c
- PR feedback
  Landon Shumway
  committed
  6a965de
- fix commment
  Landon Shumway
  committed
  8f79d4d
- Add Search API Stack with resources
  Landon Shumway
  committed
  ad4cca8
- Formatting
  Landon Shumway
  committed
  6fff21a
- WIP - add lambda to index provider documents
  Landon Shumway
  committed
  91236e5
- add lambda runtime logic to index provider documents
  Landon Shumway
  committed
  fc20257
- PR feedback
  Landon Shumway
  committed
  7bfafe7
- serialize provider documents before indexing
  Landon Shumway
  committed
  391d57b
- Do not specify index in bulk index body
  Landon Shumway
  committed
  6ebb48d
- Restrict api access to search operation
  Landon Shumway
  committed
  6eb717b
- Add search api spec
  Landon Shumway
  committed
  e13a875
- update download spec script
  Landon Shumway
  committed
  c552bec
- remove lines added from merge conflict
  Landon Shumway
  committed
  bf8e6da
- update requirements to latest
  Landon Shumway
  committed
  4117c1c
- Add test coverage for search related logic
  Landon Shumway
  committed
  98cb664
- update domain engine version to latest
  Landon Shumway
  committed
  6939625
Commits on Dec 3, 2025
- Extract domain definition into separate construct
  Landon Shumway
  committed
  e6f21d5
- PR feedback
  Landon Shumway
  committed
  da4e5e2
- support pagination for large data sets
  Landon Shumway
  committed
  a7d7b70
- formatting
  Landon Shumway
  committed
  21ef219
- Add retry logic to handle read timeout errors
  Landon Shumway
  committed
  4324249
Commits on Dec 4, 2025
- update doc to match current behavior
  Landon Shumway
  committed
  558efa1
- Add military status fields to mapping
  Landon Shumway
  committed
  85d8a5b
- Formatting/linter
  Landon Shumway
  committed
  c34ab1b
- update dev requirement
  Landon Shumway
  committed
  d552e57
- Update node dependency
  Landon Shumway
  committed
  7a3be2b
- Update PR feedback
  Landon Shumway
  committed
  f42e001
Commits on Dec 5, 2025
- Update engine to latest
  Landon Shumway
  committed
  9f390df
- Add endpoint to search privileges
  Landon Shumway
  committed
  1f49f71
- logging/formatting
  Landon Shumway
  committed
  31f605d
- Update purchase requirements
  Landon Shumway
  committed
  5737ccf
- Update requirements to latest
  Landon Shumway
  committed
  a23b092
- Add notes about blue/green deployments
  Landon Shumway
  committed
  509438a
- PR feedback
  Landon Shumway
  committed
  9d3f59b
- Add documentation for search functionality
  Landon Shumway
  committed
  8e572aa
Commits on Dec 8, 2025
- fix snapshot for test
  Landon Shumway
  committed
  ded27a0
- update requirements to latest
  Landon Shumway
  committed
  8997a96
- PR feedback
  Landon Shumway
  committed
  64b51eb
- remove unused vars
  Landon Shumway
  committed
  7d0bf76
- Only return matching privileges on nested searches
  Landon Shumway
  committed
  68b4fe5
- formatting
  Landon Shumway
  committed
  e403c09
- Support privilege CSV exports
  Landon Shumway
  committed
  65181e3
- formatting
  Landon Shumway
  committed
  0421b2a
Commits on Dec 9, 2025
- update comment
  Landon Shumway
  committed
  c4f3077
- PR feedback
  Landon Shumway
  committed
  74d3361
- Return 404 if no matches found
  Landon Shumway
  committed
  d2394d7
- Search for all matches within a single query
  Landon Shumway
  committed
  2ecead7
- Add export request schema
  Landon Shumway
  committed
  87a323e
- formatting
  Landon Shumway
  committed
  dd8f133
- Add runtime auth check for search endpoints
  Landon Shumway
  committed
  687a825
- set endpoints to member variables
  Landon Shumway
  committed
  02a1ace
- fix test comments
  Landon Shumway
  committed
  05cd632
- Increase memory size of search handler
  Landon Shumway
  committed
  9e300b5
- Add DynamoDB stream ingest handler
  Landon Shumway
  committed
  da5c523
Commits on Dec 10, 2025
- PR feedback
  Landon Shumway
  committed
  4cd7897
- correct docstring
  Landon Shumway
  committed
  afbac70
- Handle deletion of documents if all provider records are removed from DynamoDB
  Landon Shumway
  committed
  9900d88
- add test case where document has already been deleted
  Landon Shumway
  committed
  72588e2
- clarify log markers
  Landon Shumway
  committed
  d1b6acc
- Track ingest failures for retries
  Landon Shumway
  committed
  cb2fbcd
- write failures in batch
  Landon Shumway
  committed
  59428bc
- Retry failed ingest events
  Landon Shumway
  committed
  ba5b861
- Add table name env var to handler
  Landon Shumway
  committed
  19ba6b5
- reduce duplication
  Landon Shumway
  committed
  553ce7d
- remove unused var
  Landon Shumway
  committed
  213333c
- remove documents from index on retry if provider not found
  Landon Shumway
  committed
  934d2af
Commits on Dec 11, 2025
- Using event bridge pipe to process dynamodb stream
  Landon Shumway
  committed
  face0a3
- Remove unneeded search event state table
  Landon Shumway
  committed
  ee4e033
- linter/logs
  Landon Shumway
  committed
  9f5505a
- Add comments to clarify SQS retry behavior
  Landon Shumway
  committed
  c5d0783
- Reduce ingest batch size to 2000
  Landon Shumway
  committed
  de916a7
- PR feedback - deserialize records
  Landon Shumway
  committed
  77cac60
- Add query definitions for ingest and search
  Landon Shumway
  committed
  105dc7c
- Tweak ingest config based on load tests
  Landon Shumway
  committed
  58b4d36
- PR feedback
  Landon Shumway
  committed
  7e2c26d
- Update bootstrap stack permission boundary to allow new services
  Landon Shumway
  committed
  2f278ec
- Add opensearch service link role to bootstrap templates
  Landon Shumway
  committed
  59b7266
Commits on Dec 12, 2025
- update multi-account project requirements to latest
  Landon Shumway
  committed
  5d3b007
- Add additional domain config settings based on testing
  Landon Shumway
  committed
  9ac7c16
- Tweak master node instance type based on testing
  Landon Shumway
  committed
  a5b222d
- Fix PROD index shard configuration
  Landon Shumway
  committed
  899a9a2
- Set ingest pipeline to latest starting position
  Landon Shumway
  committed
  46f0045
- Add upgrade strategy notes based on findings from testing
  Landon Shumway
  committed
  eaa5406
Commits on Dec 15, 2025
- PR feedback
  Landon Shumway
  committed
  ec0d65f
- simplify check for prod env
  Landon Shumway
  committed
  2a86ea5
- remove unused params
  Landon Shumway
  committed
  16ac231
- Check for cross-index queries
  Landon Shumway
  committed
  3d449e5
- remove outdated comment
  Landon Shumway
  committed
  d9e4be8
- Return query errors to client
  Landon Shumway
  committed
  dd9f7bb
- Add domain health check logic to index manager to avoid timeouts
  Landon Shumway
  committed
  d759714
- Returning specific client error message
  Landon Shumway
  committed
  c2ad9fa
- Handling search timeouts
  Landon Shumway
  committed
  ba3f2b8
- linter
  Landon Shumway
  committed
  26c16bb
- update comments
  Landon Shumway
  committed
  6e790b1
Commits on Dec 16, 2025
- Check compact fields to prevent multi-index reaching
  Landon Shumway
  committed
  1c863ff
- Add error alarms for search and ingest
  Landon Shumway
  committed
  8b582b9
- Cleanup/update docs with latest information
  Landon Shumway
  committed
  34cf9e3
- Reduce complexity of migrations
  Landon Shumway
  committed
  506e042
- PR feedback
  Landon Shumway
  committed
  10de04e
- enable search api deployment for prod
  Landon Shumway
  committed
  84f113e
- Instantiating opensearch client outside of lambda handler
  Landon Shumway
  committed
  da2a72e
- update requirements to latest
  Landon Shumway
  committed
  1898a21
- update multi-account folder requirements to latest
  Landon Shumway
  committed
  d9b16c6
- update purchases folder requirements to latest
  Landon Shumway
  committed
  0f9b1ef
- Add comment about purpose of logging request body
  Landon Shumway
  committed
  dbfb621
Commits on Dec 22, 2025
- Initial PR feedback
  Landon Shumway
  committed
  e1f6055
- PR feedback - redact request body in log
  Landon Shumway
  committed
  62d13cb
- formatting/linter
  Landon Shumway
  committed
  3f4cc88
- update purchase dev dependency
  Landon Shumway
  committed
  68a2b25
Commits on Dec 23, 2025
- PR feedback - docs/comments
  Landon Shumway
  committed
  2fa4833
- PR feedback - remove unused field from test setup
  Landon Shumway
  committed
  2987a08
- PR feedback - add note of race condition when indexing records
  Landon Shumway
  committed
  1f49ca8
- PR feedback - clarify test comment
  Landon Shumway
  committed
  150d165
- update other test comment
  Landon Shumway
  committed
  abd1228
- filter mismatched records from search results
  Landon Shumway
  committed
  eb63ee8

Commits

Commits on Dec 2, 2025

Commits on Dec 3, 2025

Commits on Dec 4, 2025

Commits on Dec 5, 2025

Commits on Dec 8, 2025

Commits on Dec 9, 2025

Commits on Dec 10, 2025

Commits on Dec 11, 2025

Commits on Dec 12, 2025

Commits on Dec 15, 2025

Commits on Dec 16, 2025

Commits on Dec 22, 2025

Commits on Dec 23, 2025