-
Notifications
You must be signed in to change notification settings - Fork 0
PLUGIN_MIGRATION
Stand: 5. Dezember 2025
Version: 1.0.0
Kategorie: Plugins
Datum: 21. November 2025
Zweck: Zusammenführung bestehender DLL-Loader zu einem einheitlichen Plugin-System
Status: ✅ VOLLSTÄNDIG IMPLEMENTIERT
Features:
- Platform-agnostic DLL loading (Windows/Linux/macOS)
- Security verification (plugin_security.h integration)
- Plugin discovery from directory
- Signature verification (production)
- Hash-based integrity checks
- Audit logging
Interface:
class PluginLoader {
bool loadPlugin(const std::string& libraryPath);
size_t loadPluginsFromDirectory(const std::string& directoryPath);
BackendPlugin* getPlugin(const std::string& pluginName) const;
};Entry Point:
extern "C" THEMIS_PLUGIN_EXPORT BackendPlugin* CreateBackendPlugin();Verwendung:
- Compute backends (CUDA, OpenCL, Vulkan, DirectX, HIP, OneAPI)
- Prefix:
themis_accel_*.dll
Status: ✅ AD-HOC IMPLEMENTATION
Features:
- Dynamisches Laden von PKCS#11-Bibliotheken
- Windows: LoadLibraryA / GetProcAddress
- Linux: dlopen / dlsym
- Function pointer loading: C_GetFunctionList
Code:
// src/security/hsm_provider_pkcs11.cpp (Zeilen 32-52)
#ifdef _WIN32
lib_ = LoadLibraryA(path.c_str());
auto getFn = (CK_C_GetFunctionList)GetProcAddress((HMODULE)lib_, "C_GetFunctionList");
#else
lib_ = dlopen(path.c_str(), RTLD_NOW);
auto getFn = (CK_C_GetFunctionList)dlsym(lib_, "C_GetFunctionList");
#endifProblem:
- Keine Security-Verifikation
- Keine Hash-Checks
- Duplizierter Code für DLL-Loading
- Kein Plugin-Registry
Status: ✅ AD-HOC IMPLEMENTATION
Features:
- Dynamisches Laden von libcuda.so.zluda (ZLUDA = CUDA on AMD)
- Fallback zu libcuda.so
- Function pointer loading für CUDA API
Code:
// src/acceleration/zluda_backend.cpp (Zeilen 95-97)
zludaLib_ = dlopen("libcuda.so.zluda", RTLD_NOW);
if (!zludaLib_) {
zludaLib_ = dlopen("libcuda.so", RTLD_NOW);
}Problem:
- Hardcoded library names
- Keine Konfiguration
- Keine Fallback-Strategie
- Duplizierter DLL-Loading-Code
✅ Neue Komponenten:
-
include/plugins/plugin_interface.h- Unified interface -
include/plugins/plugin_manager.h- Erweitert acceleration/PluginLoader -
docs/plugins/PLUGIN_MIGRATION.md- Dieses Dokument
Key Design Decisions:
- ✅ Reuse acceleration/plugin_loader.cpp für Platform-Loading
- ✅ Reuse acceleration/plugin_security.h für Verification
- ✅ Extend mit Plugin Manifests (plugin.json)
- ✅ Extend mit Type-based Registry
Vorher:
// src/security/hsm_provider_pkcs11.cpp
void* lib_ = dlopen(path.c_str(), RTLD_NOW);
auto getFn = (CK_C_GetFunctionList)dlsym(lib_, "C_GetFunctionList");Nachher:
// src/security/hsm_provider_pkcs11.cpp
class PKCS11Plugin : public IThemisPlugin {
PluginType getType() const override { return PluginType::HSM_PROVIDER; }
void* getInstance() override { return &hsm_provider_; }
};
// Auto-load via PluginManager
auto plugin = PluginManager::instance().loadPlugin("pkcs11");
auto* provider = static_cast<HSMProvider*>(plugin->getInstance());Benefits:
- ✅ Security verification
- ✅ Unified loading
- ✅ Plugin registry
- ✅ Hot-reload support
Vorher:
// src/acceleration/zluda_backend.cpp
zludaLib_ = dlopen("libcuda.so.zluda", RTLD_NOW);Nachher:
// plugins/compute/zluda/themis_accel_zluda.cpp
class ZLUDAPlugin : public acceleration::BackendPlugin {
// Already uses BackendPlugin interface!
// Just move to separate DLL
};
// plugin.json
{
"name": "zluda",
"type": "compute_backend",
"binary": {
"linux": "themis_accel_zluda.so"
},
"auto_load": false // Load on-demand
}Benefits:
- ✅ ZLUDA nur laden wenn benötigt (nicht standardmäßig)
- ✅ Kleinere Core-Binary
- ✅ Einfacher zu testen (AMD-Hardware optional)
Structure:
plugins/
├── blob/
│ ├── filesystem/
│ │ ├── themis_blob_fs.dll
│ │ ├── plugin.json
│ │ └── CMakeLists.txt
│ ├── webdav/
│ │ ├── themis_blob_webdav.dll
│ │ ├── plugin.json
│ │ └── CMakeLists.txt
│ └── s3/
│ ├── themis_blob_s3.dll
│ ├── plugin.json
│ └── CMakeLists.txt
plugin.json (Filesystem):
{
"name": "filesystem",
"version": "1.0.0",
"type": "blob_storage",
"description": "Local filesystem blob storage",
"binary": {
"windows": "themis_blob_fs.dll",
"linux": "themis_blob_fs.so",
"macos": "themis_blob_fs.dylib"
},
"dependencies": [],
"capabilities": {
"streaming": false,
"batching": true,
"thread_safe": true
},
"config_schema": {
"base_path": {"type": "string", "default": "./data/blobs"}
},
"auto_load": true,
"load_priority": 10
}Structure:
plugins/
├── importers/
│ ├── postgres/
│ │ ├── themis_import_pg.dll
│ │ ├── plugin.json
│ │ └── CMakeLists.txt
│ └── csv/
│ ├── themis_import_csv.dll
│ ├── plugin.json
│ └── CMakeLists.txt
# Root CMakeLists.txt
option(BUILD_PLUGINS "Build plugins as separate DLLs" ON)
if(BUILD_PLUGINS)
add_subdirectory(plugins)
endif()
# plugins/CMakeLists.txt (NEW)
add_subdirectory(blob)
add_subdirectory(importers)
add_subdirectory(compute) # Existing acceleration plugins
# plugins/blob/filesystem/CMakeLists.txt (NEW)
add_library(themis_blob_fs SHARED
filesystem_plugin.cpp
../../../src/storage/blob_backend_filesystem.cpp
)
target_link_libraries(themis_blob_fs PRIVATE themis_core)
set_target_properties(themis_blob_fs PROPERTIES
LIBRARY_OUTPUT_DIRECTORY "${CMAKE_BINARY_DIR}/plugins/blob"
)// src/main_server.cpp
#include "plugins/plugin_manager.h"
int main() {
// Initialize plugin system
auto& pm = PluginManager::instance();
pm.scanPluginDirectory("./plugins");
pm.autoLoadPlugins();
// Existing code...
}// src/security/hsm_provider_pkcs11.cpp
// BEFORE: Direct dlopen
void* lib_ = dlopen(config_.library_path.c_str(), RTLD_NOW);
// AFTER: Use PluginManager
auto plugin = PluginManager::instance().loadPluginFromPath(
config_.library_path,
json{{"slot_id", config_.slot_id}}.dump()
);| Aspect | Before (3 separate loaders) | After (Unified) |
|---|---|---|
| Code Duplication | 3x DLL loading code | 1x shared code |
| Security | Only acceleration/ has it | All plugins verified |
| Discovery | Manual path specification | Auto-discovery |
| Hot-Reload | Not supported | Supported |
| Manifest | No metadata | plugin.json |
| Dependency Mgmt | Manual | Automatic |
| Type Safety | Generic void* | Type-based registry |
- Create unified plugin interface
- Create PluginManager (extends PluginLoader)
- Write migration documentation
- Test plan
- Refactor HSM Provider to use PluginManager
- Extract ZLUDA to separate plugin DLL
- Update build system
- Blob Storage plugins (Filesystem, WebDAV)
- Importer plugins (PostgreSQL, CSV)
- Integration tests
- Plugin Development Guide
- API Reference
- Example plugins
Step 1: Create Plugin Wrapper
// plugins/hsm/pkcs11/pkcs11_plugin.cpp
#include "plugins/plugin_interface.h"
#include "security/hsm_provider.h"
class PKCS11Plugin : public IThemisPlugin {
private:
std::unique_ptr<HSMProvider> provider_;
public:
const char* getName() const override { return "pkcs11"; }
const char* getVersion() const override { return "1.0.0"; }
PluginType getType() const override { return PluginType::HSM_PROVIDER; }
PluginCapabilities getCapabilities() const override {
PluginCapabilities caps;
caps.thread_safe = true;
return caps;
}
bool initialize(const char* config_json) override {
auto config = json::parse(config_json);
HSMConfig hsm_config;
hsm_config.library_path = config["library_path"];
hsm_config.slot_id = config["slot_id"];
hsm_config.pin = config["pin"];
provider_ = std::make_unique<HSMProvider>(hsm_config);
return provider_->initialize();
}
void shutdown() override {
if (provider_) provider_->finalize();
}
void* getInstance() override {
return provider_.get();
}
};
THEMIS_PLUGIN_IMPL(PKCS11Plugin)Step 2: Create Manifest
// plugins/hsm/pkcs11/plugin.json
{
"name": "pkcs11",
"version": "1.0.0",
"type": "hsm_provider",
"description": "PKCS#11 Hardware Security Module Provider",
"binary": {
"windows": "themis_hsm_pkcs11.dll",
"linux": "themis_hsm_pkcs11.so"
},
"dependencies": [
"pkcs11-library (runtime)"
],
"config_schema": {
"library_path": {"type": "string", "required": true},
"slot_id": {"type": "number", "default": 0},
"pin": {"type": "string", "required": true}
},
"auto_load": false
}Step 3: Update Usage
// OLD (src/security/some_service.cpp)
HSMConfig config;
config.library_path = "/usr/lib/softhsm/libsofthsm2.so";
config.slot_id = 0;
config.pin = "1234";
auto hsm = std::make_unique<HSMProvider>(config);
hsm->initialize();
// NEW
auto plugin = PluginManager::instance().loadPlugin("pkcs11");
auto* hsm = static_cast<HSMProvider*>(plugin->getInstance());Status: ✅ Design Complete, Ready for Implementation
Next: Implementation der PluginManager-Klasse
ThemisDB v1.3.4 | GitHub | Documentation | Discussions | License
Last synced: January 02, 2026 | Commit: 6add659
Version: 1.3.0 | Stand: Dezember 2025
- Übersicht
- Home
- Dokumentations-Index
- Quick Reference
- Sachstandsbericht 2025
- Features
- Roadmap
- Ecosystem Overview
- Strategische Übersicht
- Geo/Relational Storage
- RocksDB Storage
- MVCC Design
- Transaktionen
- Time-Series
- Memory Tuning
- Chain of Thought Storage
- Query Engine & AQL
- AQL Syntax
- Explain & Profile
- Rekursive Pfadabfragen
- Temporale Graphen
- Zeitbereichs-Abfragen
- Semantischer Cache
- Hybrid Queries (Phase 1.5)
- AQL Hybrid Queries
- Hybrid Queries README
- Hybrid Query Benchmarks
- Subquery Quick Reference
- Subquery Implementation
- Content Pipeline
- Architektur-Details
- Ingestion
- JSON Ingestion Spec
- Enterprise Ingestion Interface
- Geo-Processor Design
- Image-Processor Design
- Hybrid Search Design
- Fulltext API
- Hybrid Fusion API
- Stemming
- Performance Tuning
- Migration Guide
- Future Work
- Pagination Benchmarks
- Enterprise README
- Scalability Features
- HTTP Client Pool
- Build Guide
- Implementation Status
- Final Report
- Integration Analysis
- Enterprise Strategy
- Verschlüsselungsstrategie
- Verschlüsselungsdeployment
- Spaltenverschlüsselung
- Encryption Next Steps
- Multi-Party Encryption
- Key Rotation Strategy
- Security Encryption Gap Analysis
- Audit Logging
- Audit & Retention
- Compliance Audit
- Compliance
- Extended Compliance Features
- Governance-Strategie
- Compliance-Integration
- Governance Usage
- Security/Compliance Review
- Threat Model
- Security Hardening Guide
- Security Audit Checklist
- Security Audit Report
- Security Implementation
- Development README
- Code Quality Pipeline
- Developers Guide
- Cost Models
- Todo Liste
- Tool Todo
- Core Feature Todo
- Priorities
- Implementation Status
- Roadmap
- Future Work
- Next Steps Analysis
- AQL LET Implementation
- Development Audit
- Sprint Summary (2025-11-17)
- WAL Archiving
- Search Gap Analysis
- Source Documentation Plan
- Changefeed README
- Changefeed CMake Patch
- Changefeed OpenAPI
- Changefeed OpenAPI Auth
- Changefeed SSE Examples
- Changefeed Test Harness
- Changefeed Tests
- Dokumentations-Inventar
- Documentation Summary
- Documentation TODO
- Documentation Gap Analysis
- Documentation Consolidation
- Documentation Final Status
- Documentation Phase 3
- Documentation Cleanup Validation
- API
- Authentication
- Cache
- CDC
- Content
- Geo
- Governance
- Index
- LLM
- Query
- Security
- Server
- Storage
- Time Series
- Transaction
- Utils
Vollständige Dokumentation: https://makr-code.github.io/ThemisDB/