You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@sourcelume.apache.org by an...@apache.org on 2026/10/04 14:19:40 UTC
(sourcelume-registry) branch ingest updated (74a832d -> a583cdf)
This is an automated email from the ASF dual-hosted git repository.
ANierbeck pushed a change to branch ingest
in repository https://gitbox.apache.org/repos/asf/sourcelume-registry.git
omit 74a832d Address the review findings on the sync rework
omit af37704 Rewrite the ingest documentation for the synchronous model
omit fb3aede Store the verdict's context on the record
omit 34a6ba1 Validate inline on submission and move to the verdict-only status model
omit 74ba9fa Move the ingest pipeline into the runtime and drop the worker app
omit 6f02e90 Address the review findings on the Atlas fixes and the IT infrastructure
omit 1f654bc Document how to run the Atlas integration tests
omit 1dd80fe Fix the typedef enum and the INCOMPLETE write found by the first real-Atlas run
omit 01b59e3 Add integration tests against a real Apache Atlas via Testcontainers
omit cec8393 Fix the Atlas REST details found in the draft review
omit bb84c09 Fix stale validation issues and the resubmission race in ingest
omit 7b22bd0 Document the ingest pipeline
omit c652a91 Add the ingest worker container setup
omit a76b0ff Implement the ingest pipeline and scheduler
omit 5ea6cc0 Wire the validator chain in the ingest worker
omit c95614c Add the ingest worker module skeleton
omit b448cd1 Add ingest endpoints: submit records, watch their status
omit d51aa20 Extract the Atlas adapter into its own module
omit aa8599e Add the ingest SPI and status search to the core and the Atlas adapter
omit 4b60808 Add the ProvenanceRecordMapper for JSON-LD to DTO binding
omit 6d88391 Add the record status and lifecycle fields to the dataset DTO
omit 60d937f Add the record status enum and ingest lifecycle attributes to the typedefs
omit 108b1b6 Close remaining review findings on validation hardening and wiring
omit ab64bbf Wire validation into the Quarkus runtime and expose a validate endpoint
omit fbe27cd Close validation bypasses found in code review
omit 4b2d8c3 Document the record validation architecture
omit 50ee83d Add validator chain discovery integration test
omit eedc38b Add SHACL validation plugin module (Apache Jena)
omit 037102f Add JSON Schema validation plugin module
omit 75b6432 Add RecordValidator SPI and ValidatorChain to the core
add 5e61a60 Inherit from the Apache parent POM
add 903a636 Enforce license headers with Apache RAT
add 164e808 Configure Spotless and Checkstyle
add c15094e Apply Spotless formatting
add 90aac32 Enforce Spotless and Checkstyle in the build
add ddbf7bd Add a GitHub Actions build
add 55bfa2f Add .asf.yaml with branch protection and required CI check
add 7c78000 Merge pull request #4 from apache/ci
add 83df092 Add RecordValidator SPI and ValidatorChain to the core
add 405905a Add JSON Schema validation plugin module
add c5a1065 Add SHACL validation plugin module (Apache Jena)
add a9a0900 Add validator chain discovery integration test
add d1365c2 Document the record validation architecture
add f8fc5c2 Close validation bypasses found in code review
add a63efbd Wire validation into the Quarkus runtime and expose a validate endpoint
add 41a7081 Close remaining review findings on validation hardening and wiring
add 7a1674b Add the record status enum and ingest lifecycle attributes to the typedefs
add f28c46d Add the record status and lifecycle fields to the dataset DTO
add 9fb3349 Add the ProvenanceRecordMapper for JSON-LD to DTO binding
add 2e9099d Add the ingest SPI and status search to the core and the Atlas adapter
add 7be359d Extract the Atlas adapter into its own module
add 3a0356d Add ingest endpoints: submit records, watch their status
add b6b0154 Add the ingest worker module skeleton
add 3690325 Wire the validator chain in the ingest worker
add 2e7f0ca Implement the ingest pipeline and scheduler
add 4aee59e Add the ingest worker container setup
add 61dc411 Document the ingest pipeline
add a092c20 Fix stale validation issues and the resubmission race in ingest
add ea2814c Fix the Atlas REST details found in the draft review
add 0f23a61 Add integration tests against a real Apache Atlas via Testcontainers
add 1862436 Fix the typedef enum and the INCOMPLETE write found by the first real-Atlas run
add d553cb5 Document how to run the Atlas integration tests
add bca9ac8 Address the review findings on the Atlas fixes and the IT infrastructure
add 755088e Move the ingest pipeline into the runtime and drop the worker app
add 4129f0e Validate inline on submission and move to the verdict-only status model
add bd29461 Store the verdict's context on the record
add 9da9b6f Rewrite the ingest documentation for the synchronous model
add a583cdf Address the review findings on the sync rework
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (74a832d)
\
N -- N -- N refs/heads/ingest (a583cdf)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 38 ++
.git-blame-ignore-revs | 5 +
.github/workflows/ci.yml | 75 ++++
dev-support/README.md | 17 +
dev/checkstyle.xml | 50 +++
.../license-header.txt | 17 +-
docs/validation.md | 17 +
pom.xml | 401 +++++++++++++--------
sourcelume-registry-atlas-adapter/pom.xml | 176 +++++----
.../registry/atlas/adapter/RestAtlasAdapter.java | 88 +++--
.../adapter/config/SourcelumeAtlasProperties.java | 8 +-
.../atlas/adapter/RestAtlasAdapterSearchTest.java | 68 ++--
.../atlas/adapter/RestAtlasAdapterTest.java | 17 +-
sourcelume-registry-common/pom.xml | 108 +++---
.../sourcelume/registry/common/dto/CreatorDto.java | 16 +-
.../registry/common/dto/CustodyEventDto.java | 21 +-
.../registry/common/dto/LicenseHistoryDto.java | 14 +-
.../registry/common/dto/ProvenanceRecordDto.java | 17 +-
.../registry/common/dto/RecordStatus.java | 3 +-
.../registry/common/dto/SourcelumeDatasetDto.java | 21 +-
.../common/exception/SourcelumeException.java | 2 +-
.../exception/SourcelumeNotFoundException.java | 2 +-
.../exception/SourcelumeValidationException.java | 2 +-
.../common/mapper/ProvenanceRecordMapper.java | 6 +-
.../registry/common/spec/SpecResourceLoader.java | 15 +-
.../common/dto/ProvenanceRecordDtoTest.java | 20 +-
.../common/dto/SourcelumeDatasetDtoTest.java | 12 +-
.../common/mapper/ProvenanceRecordMapperTest.java | 24 +-
.../common/spec/SpecResourceLoaderTest.java | 12 +-
sourcelume-registry-core/pom.xml | 52 ++-
.../sourcelume/registry/core/AtlasAdapter.java | 4 +-
.../core/exception/AtlasAdapterException.java | 2 +-
.../registry/core/ingest/IngestResult.java | 13 +-
.../registry/core/ingest/IngestService.java | 3 +-
.../registry/core/validation/RecordValidator.java | 7 +-
.../registry/core/validation/ValidationIssue.java | 7 +-
.../registry/core/validation/ValidationResult.java | 10 +-
.../core/validation/ValidationService.java | 8 +-
.../registry/core/validation/ValidatorChain.java | 22 +-
.../registry/core/ingest/IngestResultTest.java | 33 +-
.../core/validation/ValidationServiceTest.java | 26 +-
.../core/validation/ValidatorChainTest.java | 56 ++-
sourcelume-registry-runtime-quarkus/pom.xml | 315 ++++++++--------
.../quarkus/SourcelumeRegistryApplication.java | 2 +-
.../quarkus/bootstrap/AtlasBootstrapObserver.java | 8 +-
.../quarkus/bootstrap/AtlasBootstrapService.java | 7 +-
.../quarkus/health/AtlasReadinessCheck.java | 4 +-
.../runtime/quarkus/ingest/IngestResource.java | 76 ++--
.../quarkus/ingest/service/IngestServiceImpl.java | 38 +-
.../validation/RecordValidationResource.java | 13 +-
.../quarkus/validation/ValidatorChainProducer.java | 6 +-
.../bootstrap/AtlasBootstrapServiceTest.java | 13 +-
.../quarkus/health/AtlasReadinessCheckTest.java | 12 +-
.../quarkus/ingest/IngestResourceHttpTest.java | 19 +-
.../runtime/quarkus/ingest/IngestResourceTest.java | 60 +--
.../runtime/quarkus/ingest/service/Digests.java | 6 +-
.../ingest/service/IngestServiceImplTest.java | 46 +--
.../runtime/quarkus/it/AtlasComposeResource.java | 39 +-
.../runtime/quarkus/it/AtlasITProfile.java | 4 +-
.../runtime/quarkus/it/IngestPipelineIT.java | 75 ++--
.../validation/PluginlessDiscoveryTest.java | 22 +-
.../validation/RecordValidationResourceTest.java | 71 ++--
sourcelume-registry-typedefs/pom.xml | 60 ++-
.../registry/typedefs/TypeDefinitionModelTest.java | 25 +-
sourcelume-registry-validation-jsonschema/pom.xml | 66 ++--
.../jsonschema/JsonSchemaRecordValidator.java | 23 +-
.../jsonschema/JsonSchemaRecordValidatorTest.java | 22 +-
sourcelume-registry-validation-shacl/pom.xml | 84 ++---
.../validation/shacl/JsonLdContextInliner.java | 29 +-
.../validation/shacl/ShaclRecordValidator.java | 62 ++--
.../validation/shacl/JsonLdContextInlinerTest.java | 80 ++--
.../validation/shacl/ShaclRecordValidatorTest.java | 48 +--
.../shacl/ValidatorChainDiscoveryTest.java | 38 +-
73 files changed, 1561 insertions(+), 1327 deletions(-)
create mode 100644 .asf.yaml
create mode 100644 .git-blame-ignore-revs
create mode 100644 .github/workflows/ci.yml
create mode 100644 dev/checkstyle.xml
copy sourcelume-registry-common/src/main/java/org/apache/sourcelume/registry/common/exception/SourcelumeException.java => dev/license-header.txt (62%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@sourcelume.apache.org
For additional commands, e-mail: commits-help@sourcelume.apache.org