Skip to content

Pulling changes from wip to dev#98

Merged
Thirunayan22 merged 169 commits intodevfrom
wip
Dec 17, 2025
Merged

Pulling changes from wip to dev#98
Thirunayan22 merged 169 commits intodevfrom
wip

Conversation

@Thirunayan22
Copy link

@Thirunayan22 Thirunayan22 commented Dec 17, 2025

No description provided.

erangi-ar and others added 30 commits September 2, 2025 12:30
Add LLM Connections and Inference Results API endpoints documentation
b12a2a3
@nuwangeek
created docker-compose.yml with initial services
07ecb32
@nuwangeek
fixed issue
a6a2c11
@nuwangeek
change network name to bykstack
9d06d18
@Thirunayan22
Merge pull request #1 from rootcodelabs/RAG-17
3201850 
Pushing changes from RAG-17 to WIP
@nuwangeek
Merge pull request #4 from rootcodelabs/dev
4278438 
Get update from dev into wip
@nuwangeek
fix ruff linting issue
1f1ed60
@nuwangeek
Merge pull request #5 from rootcodelabs/wip
6aceb2e 
Get update from wip into RAG-16
@nuwangeek
added gitignore file
af5b697
@Thirunayan22
Merge pull request #6 from buerokratt/wip
8860b0c 
Pulling changes from BYK WIP to RTC RAG-16
@Thirunayan22
Merge pull request #7 from buerokratt/dev
b2b9448 
Pulling changes from BYK WIP to dev
@Thirunayan22
Merge pull request #8 from rootcodelabs/wip
36a9115 
Pulling changes from RTC WIP to RAG-17
@Thirunayan22
added intentional invalid code to check ci
0a26763
@Thirunayan22
added fake key exposure to check gitleaks ci
381e6a5
@Thirunayan22
added .gitignore
b5a370d
@Thirunayan22
Merge pull request #53 from rootcodelabs/RAG-17
ea6fb6f 
Pushing changes from RTC RAG-17 to WIP
@Thirunayan22
Merge branch 'RAG-16' into wip
e100d14
@Thirunayan22
Merge pull request #11 from buerokratt/wip
074abd4 
Pulling changes from BYK WIP to RAG-17
@Thirunayan22
updated pre-commit hooks
c28f030
@Thirunayan22
added pre-commit hook configs
8f27289
@Thirunayan22
updated contributors.md and added pre-commit config
e386b38
@Thirunayan22
updated pre-commit hook
ef2e58e
@Thirunayan22
Merge pull request #54 from rootcodelabs/RAG-17
d330283 
Pushing changes from RAG-17 to BYK WIP
@Thirunayan22
updated contributing.md (#56)
0652f0e
@Thirunayan22 @nuwangeek
Pulling changs from Dev to WIP (#58)
f89a608 
* Pushing updates from WIP to Dev (#55)

* created docker-compose.yml with initial services

* fixed issue

* change network name to bykstack

* fix ruff linting issue

* added gitignore file

* added intentional invalid code to check ci

* added fake key exposure to check gitleaks ci

* added .gitignore

* updated pre-commit hooks

* added pre-commit hook configs

* updated contributors.md and added pre-commit config

* updated pre-commit hook

---------

Co-authored-by: nuwangeek <charith.bimsara@rootcode.io>
Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>

* Pushing changes from WIP to Dev (#57)

* created docker-compose.yml with initial services

* fixed issue

* change network name to bykstack

* fix ruff linting issue

* added gitignore file

* added intentional invalid code to check ci

* added fake key exposure to check gitleaks ci

* added .gitignore

* updated pre-commit hooks

* added pre-commit hook configs

* updated contributors.md and added pre-commit config

* updated pre-commit hook

* updated contributing.md (#56)

---------

Co-authored-by: nuwangeek <charith.bimsara@rootcode.io>
Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>

---------

Co-authored-by: nuwangeek <charith.bimsara@rootcode.io>
Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
@nuwangeek
Merge pull request #14 from buerokratt/wip
6c4e28b 
Get Update from buerokratt/RAG-Module wip  into rootcodelabs/RAG-Module wip
@nuwangeek
Merge pull request #15 from rootcodelabs/wip
ce77539 
Get update from wip to RAG-6
@nuwangeek
initial config manager module
6144b62
@nuwangeek
get pull and fixed merge conflicts
b16629f
project initialization
e4f26bc
erangi-ar and others added 28 commits November 26, 2025 17:06
@erangi-ar @nuwangeek
Rag 149- Show chunk context in Test LLM Connection Page (buerokratt#173)
c33f951 
* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* Vault Authentication token handling (buerokratt#154) (#70)

* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* added initial setup for the vector indexer

* initial llm orchestration service update with context generation

* added new endpoints

* vector indexer with contextual retrieval

* fixed requested changes

* fixed issue

* initial diff identifier setup

* uncommment docker compose file

* added test endpoint for orchestrate service

* fixed ruff linting issue

* Rag 103 budget related schema changes (#41)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

---------



* Rag 93 update connection status (#47)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Implement LLM connection status update functionality with API integration and UI enhancements

---------



* Rag 99 production llm connections logic (#46)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Add production connection retrieval and update related components

* Implement LLM connection environment update and enhance connection management logic

---------



* Rag 119 endpoint to update used budget (#42)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add functionality to update used budget for LLM connections with validation and response handling

* Implement budget threshold checks and connection deactivation logic in update process

* resolve pr comments

---------



* Rag 113 warning and termination banners (#43)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add budget status check and update BudgetBanner component

* rename commonUtils

* resove pr comments

---------



* rag-105-reset-used-budget-cron-job (#44)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add cron job to reset used budget

* rename commonUtils

* resolve pr comments

* Remove trailing slash from vault/agent-out in .gitignore

---------



* Rag 101 budget check functionality (#45)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* budget check functionality

---------



* gui running on 3003 issue fixed

* gui running on 3003 issue fixed (#50)



* added get-configuration.sqpl and updated llmconnections.ts

* Add SQL query to retrieve configuration values

* Hashicorp key saving (#51)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

---------



* Remove REACT_APP_NOTIFICATION_NODE_URL variable

Removed REACT_APP_NOTIFICATION_NODE_URL environment variable.

* added initil diff identifier functionality

* test phase1

* Refactor inference and connection handling in YAML and TypeScript files

* fixes (#52)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

---------



* Add entry point script for Vector Indexer with command line interface

* fix (#53)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

* Add entry point script for Vector Indexer with command line interface

---------



* diff fixes

* uncomment llm orchestration service in docker compose file

* complete vector indexer

* Add YAML configurations and scripts for managing vault secrets

* Add vault secret management functions and endpoints for LLM connections

* Add Test Production LLM page with messaging functionality and styles

* fixed issue

* fixed merge conflicts

* fixed issue

* fixed issue

* updated with requested chnages

* fixed test ui endpoint request responses schema issue

* fixed dvc path issue

* added dspy optimization

* filters fixed

* refactor: restructure llm_connections table for improved configuration and tracking

* feat: enhance LLM connection handling with AWS and Azure embedding credentials

* fixed issues

* refactor: remove redundant Azure and AWS credential assignments in vault secret functions

* fixed issue

* intial vault setup script

* complete vault authentication handling

* review requested change fix

* fixed issues according to the pr review

* fixed issues in docker compose file relevent to pr review

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* Add context section with collapsible display for inference results

* chunks integration

* testing

* security improvements

* fix guardrail issue

* fix review comments

* fixed issue

* remove optimized modules

* remove unnesesary file

* fix typo

* fixed review

* soure metadata rename and optimize input guardrail flow

* optimized components

* remove unnesessary files

* fixed ruff format issue

* fixed requested changes

* fixed ruff format issue

* tested and improved chunk retrieval quality and performance

* complete backed logic to show chunks in test ui

* hide inference result loading state in UI

* resolve pr comments

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: nuwangeek <charith.bimsara@rootcode.io>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>
@nuwangeek
Merge pull request #87 from buerokratt/wip
fa925ed 
Rag 149- Show chunk context in Test LLM Connection Page (buerokratt#173)
@erangi-ar @nuwangeek
QA bug fixes (buerokratt#174)
9200fc4 
* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* Vault Authentication token handling (buerokratt#154) (#70)

* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* added initial setup for the vector indexer

* initial llm orchestration service update with context generation

* added new endpoints

* vector indexer with contextual retrieval

* fixed requested changes

* fixed issue

* initial diff identifier setup

* uncommment docker compose file

* added test endpoint for orchestrate service

* fixed ruff linting issue

* Rag 103 budget related schema changes (#41)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

---------



* Rag 93 update connection status (#47)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Implement LLM connection status update functionality with API integration and UI enhancements

---------



* Rag 99 production llm connections logic (#46)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Add production connection retrieval and update related components

* Implement LLM connection environment update and enhance connection management logic

---------



* Rag 119 endpoint to update used budget (#42)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add functionality to update used budget for LLM connections with validation and response handling

* Implement budget threshold checks and connection deactivation logic in update process

* resolve pr comments

---------



* Rag 113 warning and termination banners (#43)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add budget status check and update BudgetBanner component

* rename commonUtils

* resove pr comments

---------



* rag-105-reset-used-budget-cron-job (#44)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add cron job to reset used budget

* rename commonUtils

* resolve pr comments

* Remove trailing slash from vault/agent-out in .gitignore

---------



* Rag 101 budget check functionality (#45)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* budget check functionality

---------



* gui running on 3003 issue fixed

* gui running on 3003 issue fixed (#50)



* added get-configuration.sqpl and updated llmconnections.ts

* Add SQL query to retrieve configuration values

* Hashicorp key saving (#51)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

---------



* Remove REACT_APP_NOTIFICATION_NODE_URL variable

Removed REACT_APP_NOTIFICATION_NODE_URL environment variable.

* added initil diff identifier functionality

* test phase1

* Refactor inference and connection handling in YAML and TypeScript files

* fixes (#52)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

---------



* Add entry point script for Vector Indexer with command line interface

* fix (#53)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

* Add entry point script for Vector Indexer with command line interface

---------



* diff fixes

* uncomment llm orchestration service in docker compose file

* complete vector indexer

* Add YAML configurations and scripts for managing vault secrets

* Add vault secret management functions and endpoints for LLM connections

* Add Test Production LLM page with messaging functionality and styles

* fixed issue

* fixed merge conflicts

* fixed issue

* fixed issue

* updated with requested chnages

* fixed test ui endpoint request responses schema issue

* fixed dvc path issue

* added dspy optimization

* filters fixed

* refactor: restructure llm_connections table for improved configuration and tracking

* feat: enhance LLM connection handling with AWS and Azure embedding credentials

* fixed issues

* refactor: remove redundant Azure and AWS credential assignments in vault secret functions

* fixed issue

* intial vault setup script

* complete vault authentication handling

* review requested change fix

* fixed issues according to the pr review

* fixed issues in docker compose file relevent to pr review

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* Enhance LLM connection update SQL and improve responsive design in LLMConnectionForm

* temp revert env update logic

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: nuwangeek <charith.bimsara@rootcode.io>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>
@nuwangeek
Merge pull request #88 from buerokratt/wip
eb0e3b5 
QA bug fixes (buerokratt#174)
@nuwangeek
Make #chunks configurable (buerokratt#179)
ce64949
@Thirunayan22 @nuwangeek @erangi-ar
Typechecking and linter rule updates (buerokratt#180)
1d25d90 
* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* Vault Authentication token handling (buerokratt#154) (#70)

* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* added initial setup for the vector indexer

* initial llm orchestration service update with context generation

* added new endpoints

* vector indexer with contextual retrieval

* fixed requested changes

* fixed issue

* initial diff identifier setup

* uncommment docker compose file

* added test endpoint for orchestrate service

* fixed ruff linting issue

* Rag 103 budget related schema changes (#41)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

---------



* Rag 93 update connection status (#47)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Implement LLM connection status update functionality with API integration and UI enhancements

---------



* Rag 99 production llm connections logic (#46)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Add production connection retrieval and update related components

* Implement LLM connection environment update and enhance connection management logic

---------



* Rag 119 endpoint to update used budget (#42)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add functionality to update used budget for LLM connections with validation and response handling

* Implement budget threshold checks and connection deactivation logic in update process

* resolve pr comments

---------



* Rag 113 warning and termination banners (#43)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add budget status check and update BudgetBanner component

* rename commonUtils

* resove pr comments

---------



* rag-105-reset-used-budget-cron-job (#44)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add cron job to reset used budget

* rename commonUtils

* resolve pr comments

* Remove trailing slash from vault/agent-out in .gitignore

---------



* Rag 101 budget check functionality (#45)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* budget check functionality

---------



* gui running on 3003 issue fixed

* gui running on 3003 issue fixed (#50)



* added get-configuration.sqpl and updated llmconnections.ts

* Add SQL query to retrieve configuration values

* Hashicorp key saving (#51)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

---------



* Remove REACT_APP_NOTIFICATION_NODE_URL variable

Removed REACT_APP_NOTIFICATION_NODE_URL environment variable.

* added initil diff identifier functionality

* test phase1

* Refactor inference and connection handling in YAML and TypeScript files

* fixes (#52)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

---------



* Add entry point script for Vector Indexer with command line interface

* fix (#53)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

* Add entry point script for Vector Indexer with command line interface

---------



* diff fixes

* uncomment llm orchestration service in docker compose file

* complete vector indexer

* Add YAML configurations and scripts for managing vault secrets

* Add vault secret management functions and endpoints for LLM connections

* Add Test Production LLM page with messaging functionality and styles

* fixed issue

* fixed merge conflicts

* fixed issue

* fixed issue

* updated with requested chnages

* fixed test ui endpoint request responses schema issue

* fixed dvc path issue

* added dspy optimization

* filters fixed

* refactor: restructure llm_connections table for improved configuration and tracking

* feat: enhance LLM connection handling with AWS and Azure embedding credentials

* fixed issues

* refactor: remove redundant Azure and AWS credential assignments in vault secret functions

* fixed issue

* intial vault setup script

* complete vault authentication handling

* review requested change fix

* fixed issues according to the pr review

* fixed issues in docker compose file relevent to pr review

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* updated pyright type checking rules

* updated ruff linter specs

* added formatting rules

* updated contributing with typesafety rules in system boundaries and restricted pyright type checking to application code only and exempted tests

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: nuwangeek <charith.bimsara@rootcode.io>
Co-authored-by: erangi-ar <111747955+erangi-ar@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>
@nuwangeek
Merge pull request #90 from buerokratt/wip
8ce90c3 
Sync wip branches
@nuwangeek @erangi-ar
Update inference results and and budget (buerokratt#181)
58b23a1 
* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* Vault Authentication token handling (buerokratt#154) (#70)

* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* added initial setup for the vector indexer

* initial llm orchestration service update with context generation

* added new endpoints

* vector indexer with contextual retrieval

* fixed requested changes

* fixed issue

* initial diff identifier setup

* uncommment docker compose file

* added test endpoint for orchestrate service

* fixed ruff linting issue

* Rag 103 budget related schema changes (#41)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

---------



* Rag 93 update connection status (#47)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Implement LLM connection status update functionality with API integration and UI enhancements

---------



* Rag 99 production llm connections logic (#46)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Add production connection retrieval and update related components

* Implement LLM connection environment update and enhance connection management logic

---------



* Rag 119 endpoint to update used budget (#42)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add functionality to update used budget for LLM connections with validation and response handling

* Implement budget threshold checks and connection deactivation logic in update process

* resolve pr comments

---------



* Rag 113 warning and termination banners (#43)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add budget status check and update BudgetBanner component

* rename commonUtils

* resove pr comments

---------



* rag-105-reset-used-budget-cron-job (#44)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add cron job to reset used budget

* rename commonUtils

* resolve pr comments

* Remove trailing slash from vault/agent-out in .gitignore

---------



* Rag 101 budget check functionality (#45)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* budget check functionality

---------



* gui running on 3003 issue fixed

* gui running on 3003 issue fixed (#50)



* added get-configuration.sqpl and updated llmconnections.ts

* Add SQL query to retrieve configuration values

* Hashicorp key saving (#51)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

---------



* Remove REACT_APP_NOTIFICATION_NODE_URL variable

Removed REACT_APP_NOTIFICATION_NODE_URL environment variable.

* added initil diff identifier functionality

* test phase1

* Refactor inference and connection handling in YAML and TypeScript files

* fixes (#52)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

---------



* Add entry point script for Vector Indexer with command line interface

* fix (#53)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

* Add entry point script for Vector Indexer with command line interface

---------



* diff fixes

* uncomment llm orchestration service in docker compose file

* complete vector indexer

* Add YAML configurations and scripts for managing vault secrets

* Add vault secret management functions and endpoints for LLM connections

* Add Test Production LLM page with messaging functionality and styles

* fixed issue

* fixed merge conflicts

* fixed issue

* fixed issue

* updated with requested chnages

* fixed test ui endpoint request responses schema issue

* fixed dvc path issue

* added dspy optimization

* filters fixed

* refactor: restructure llm_connections table for improved configuration and tracking

* feat: enhance LLM connection handling with AWS and Azure embedding credentials

* fixed issues

* refactor: remove redundant Azure and AWS credential assignments in vault secret functions

* fixed issue

* intial vault setup script

* complete vault authentication handling

* review requested change fix

* fixed issues according to the pr review

* fixed issues in docker compose file relevent to pr review

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* fixed number chunk issue

* fixed ruff format  issue

* complete inference result update and budget updating

* fixed issues

* fixed ruff format issue

* fixed endpoint issue

* fixed format issues

* fixed issue

* fixed issue

---------

Co-authored-by: erangi-ar <111747955+erangi-ar@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>
@nuwangeek
Merge pull request #92 from buerokratt/wip
301a03a 
Update inference results and and budget (buerokratt#181)
code cleanups
077855e
code cleanups and formatting
cd498b4
Merge branch 'wip' of https://github.com/rootcodelabs/RAG-Module into…
988ff60 
… streaming-feature-opensearch
@nuwangeek @erangi-ar
Complete langfuse setup (buerokratt#182)
97f0583 
* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* Vault Authentication token handling (buerokratt#154) (#70)

* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* added initial setup for the vector indexer

* initial llm orchestration service update with context generation

* added new endpoints

* vector indexer with contextual retrieval

* fixed requested changes

* fixed issue

* initial diff identifier setup

* uncommment docker compose file

* added test endpoint for orchestrate service

* fixed ruff linting issue

* Rag 103 budget related schema changes (#41)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

---------



* Rag 93 update connection status (#47)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Implement LLM connection status update functionality with API integration and UI enhancements

---------



* Rag 99 production llm connections logic (#46)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Add production connection retrieval and update related components

* Implement LLM connection environment update and enhance connection management logic

---------



* Rag 119 endpoint to update used budget (#42)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add functionality to update used budget for LLM connections with validation and response handling

* Implement budget threshold checks and connection deactivation logic in update process

* resolve pr comments

---------



* Rag 113 warning and termination banners (#43)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add budget status check and update BudgetBanner component

* rename commonUtils

* resove pr comments

---------



* rag-105-reset-used-budget-cron-job (#44)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add cron job to reset used budget

* rename commonUtils

* resolve pr comments

* Remove trailing slash from vault/agent-out in .gitignore

---------



* Rag 101 budget check functionality (#45)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* budget check functionality

---------



* gui running on 3003 issue fixed

* gui running on 3003 issue fixed (#50)



* added get-configuration.sqpl and updated llmconnections.ts

* Add SQL query to retrieve configuration values

* Hashicorp key saving (#51)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

---------



* Remove REACT_APP_NOTIFICATION_NODE_URL variable

Removed REACT_APP_NOTIFICATION_NODE_URL environment variable.

* added initil diff identifier functionality

* test phase1

* Refactor inference and connection handling in YAML and TypeScript files

* fixes (#52)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

---------



* Add entry point script for Vector Indexer with command line interface

* fix (#53)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

* Add entry point script for Vector Indexer with command line interface

---------



* diff fixes

* uncomment llm orchestration service in docker compose file

* complete vector indexer

* Add YAML configurations and scripts for managing vault secrets

* Add vault secret management functions and endpoints for LLM connections

* Add Test Production LLM page with messaging functionality and styles

* fixed issue

* fixed merge conflicts

* fixed issue

* fixed issue

* updated with requested chnages

* fixed test ui endpoint request responses schema issue

* fixed dvc path issue

* added dspy optimization

* filters fixed

* refactor: restructure llm_connections table for improved configuration and tracking

* feat: enhance LLM connection handling with AWS and Azure embedding credentials

* fixed issues

* refactor: remove redundant Azure and AWS credential assignments in vault secret functions

* fixed issue

* intial vault setup script

* complete vault authentication handling

* review requested change fix

* fixed issues according to the pr review

* fixed issues in docker compose file relevent to pr review

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* fixed number chunk issue

* fixed ruff format  issue

* complete inference result update and budget updating

* fixed issues

* fixed ruff format issue

* fixed endpoint issue

* fixed format issues

* fixed issue

* fixed issue

* complete langfuse setup

* fixed review comments

---------

Co-authored-by: erangi-ar <111747955+erangi-ar@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>
@nuwangeek
Merge pull request #94 from buerokratt/wip
55b644c 
Complete langfuse setup (buerokratt#182)
Add docker-compose configuration for EC2 deployment
46fbca6
Merge branch 'wip' of https://github.com/rootcodelabs/RAG-Module into…
731a3d7 
… streaming-feature-opensearch
Fix formatting and update port mappings in docker-compose.yml
0989313
Update port mappings in docker-compose-ec2.yml to allow external access
a9169f2
Merge branch 'streaming-feature-opensearch' of https://github.com/roo…
99ad60e 
…tcodelabs/RAG-Module into rag-deployment-ec2
Add opensearch-node and notifications-node services to docker-compose…
b5fccda 
… for enhanced functionality
Add opensearch-data volume and remove opensearch-dashboards service f…
619372a 
…rom docker-compose
@nuwangeek @erangi-ar
Complete Integration test (buerokratt#184)
22d134d 
* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* Vault Authentication token handling (buerokratt#154) (#70)

* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* added initial setup for the vector indexer

* initial llm orchestration service update with context generation

* added new endpoints

* vector indexer with contextual retrieval

* fixed requested changes

* fixed issue

* initial diff identifier setup

* uncommment docker compose file

* added test endpoint for orchestrate service

* fixed ruff linting issue

* Rag 103 budget related schema changes (#41)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

---------



* Rag 93 update connection status (#47)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Implement LLM connection status update functionality with API integration and UI enhancements

---------



* Rag 99 production llm connections logic (#46)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Add production connection retrieval and update related components

* Implement LLM connection environment update and enhance connection management logic

---------



* Rag 119 endpoint to update used budget (#42)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add functionality to update used budget for LLM connections with validation and response handling

* Implement budget threshold checks and connection deactivation logic in update process

* resolve pr comments

---------



* Rag 113 warning and termination banners (#43)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add budget status check and update BudgetBanner component

* rename commonUtils

* resove pr comments

---------



* rag-105-reset-used-budget-cron-job (#44)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add cron job to reset used budget

* rename commonUtils

* resolve pr comments

* Remove trailing slash from vault/agent-out in .gitignore

---------



* Rag 101 budget check functionality (#45)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* budget check functionality

---------



* gui running on 3003 issue fixed

* gui running on 3003 issue fixed (#50)



* added get-configuration.sqpl and updated llmconnections.ts

* Add SQL query to retrieve configuration values

* Hashicorp key saving (#51)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

---------



* Remove REACT_APP_NOTIFICATION_NODE_URL variable

Removed REACT_APP_NOTIFICATION_NODE_URL environment variable.

* added initil diff identifier functionality

* test phase1

* Refactor inference and connection handling in YAML and TypeScript files

* fixes (#52)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

---------



* Add entry point script for Vector Indexer with command line interface

* fix (#53)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

* Add entry point script for Vector Indexer with command line interface

---------



* diff fixes

* uncomment llm orchestration service in docker compose file

* complete vector indexer

* Add YAML configurations and scripts for managing vault secrets

* Add vault secret management functions and endpoints for LLM connections

* Add Test Production LLM page with messaging functionality and styles

* fixed issue

* fixed merge conflicts

* fixed issue

* fixed issue

* updated with requested chnages

* fixed test ui endpoint request responses schema issue

* fixed dvc path issue

* added dspy optimization

* filters fixed

* refactor: restructure llm_connections table for improved configuration and tracking

* feat: enhance LLM connection handling with AWS and Azure embedding credentials

* fixed issues

* refactor: remove redundant Azure and AWS credential assignments in vault secret functions

* fixed issue

* intial vault setup script

* complete vault authentication handling

* review requested change fix

* fixed issues according to the pr review

* fixed issues in docker compose file relevent to pr review

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* testcontainers initial setup

* testcontainers initial setup
gitleaks solved

* test

* testcontainers initial setup
fixed issue
gitleaks solve test1

* test

* fixed conflicts

* test1

* fixed environment variable issue

* fixed secret issue in ci check flow

* removed unnecessary code lines

* remove unwanted API keys

* change branch name

* fixed requested issues

* fixed issue

* fixed issue

---------

Co-authored-by: erangi-ar <111747955+erangi-ar@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>
@erangi-ar @nuwangeek
Streaming feature with opensearch (buerokratt#186)
90636c6 
* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* Vault Authentication token handling (buerokratt#154) (#70)

* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* added initial setup for the vector indexer

* initial llm orchestration service update with context generation

* added new endpoints

* vector indexer with contextual retrieval

* fixed requested changes

* fixed issue

* initial diff identifier setup

* uncommment docker compose file

* added test endpoint for orchestrate service

* fixed ruff linting issue

* Rag 103 budget related schema changes (#41)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

---------



* Rag 93 update connection status (#47)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Implement LLM connection status update functionality with API integration and UI enhancements

---------



* Rag 99 production llm connections logic (#46)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Add production connection retrieval and update related components

* Implement LLM connection environment update and enhance connection management logic

---------



* Rag 119 endpoint to update used budget (#42)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add functionality to update used budget for LLM connections with validation and response handling

* Implement budget threshold checks and connection deactivation logic in update process

* resolve pr comments

---------



* Rag 113 warning and termination banners (#43)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add budget status check and update BudgetBanner component

* rename commonUtils

* resove pr comments

---------



* rag-105-reset-used-budget-cron-job (#44)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add cron job to reset used budget

* rename commonUtils

* resolve pr comments

* Remove trailing slash from vault/agent-out in .gitignore

---------



* Rag 101 budget check functionality (#45)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* budget check functionality

---------



* gui running on 3003 issue fixed

* gui running on 3003 issue fixed (#50)



* added get-configuration.sqpl and updated llmconnections.ts

* Add SQL query to retrieve configuration values

* Hashicorp key saving (#51)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

---------



* Remove REACT_APP_NOTIFICATION_NODE_URL variable

Removed REACT_APP_NOTIFICATION_NODE_URL environment variable.

* added initil diff identifier functionality

* test phase1

* Refactor inference and connection handling in YAML and TypeScript files

* fixes (#52)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

---------



* Add entry point script for Vector Indexer with command line interface

* fix (#53)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

* Add entry point script for Vector Indexer with command line interface

---------



* diff fixes

* uncomment llm orchestration service in docker compose file

* complete vector indexer

* Add YAML configurations and scripts for managing vault secrets

* Add vault secret management functions and endpoints for LLM connections

* Add Test Production LLM page with messaging functionality and styles

* fixed issue

* fixed merge conflicts

* fixed issue

* fixed issue

* updated with requested chnages

* fixed test ui endpoint request responses schema issue

* fixed dvc path issue

* added dspy optimization

* filters fixed

* refactor: restructure llm_connections table for improved configuration and tracking

* feat: enhance LLM connection handling with AWS and Azure embedding credentials

* fixed issues

* refactor: remove redundant Azure and AWS credential assignments in vault secret functions

* fixed issue

* intial vault setup script

* complete vault authentication handling

* review requested change fix

* fixed issues according to the pr review

* fixed issues in docker compose file relevent to pr review

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* initial streaming updates

* added notification node

* fixed requested chnges

* fixed issues

* Add LLM orchestration streaming functionality and .gitignore for node_modules

* code cleanups

* code cleanups and formatting

* Add OpenSearch configuration and refactor streaming service integration

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: nuwangeek <charith.bimsara@rootcode.io>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>
@erangi-ar @nuwangeek
Translations updates (buerokratt#187)
909c8d2 
* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* added initial setup for the vector indexer

* initial llm orchestration service update with context generation

* added new endpoints

* vector indexer with contextual retrieval

* fixed requested changes

* fixed issue

* initial diff identifier setup

* uncommment docker compose file

* added test endpoint for orchestrate service

* fixed ruff linting issue

* Rag 103 budget related schema changes (#41)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

---------

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* Rag 93 update connection status (#47)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Implement LLM connection status update functionality with API integration and UI enhancements

---------

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* Rag 99 production llm connections logic (#46)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Add production connection retrieval and update related components

* Implement LLM connection environment update and enhance connection management logic

---------

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* Rag 119 endpoint to update used budget (#42)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add functionality to update used budget for LLM connections with validation and response handling

* Implement budget threshold checks and connection deactivation logic in update process

* resolve pr comments

---------

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* Rag 113 warning and termination banners (#43)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add budget status check and update BudgetBanner component

* rename commonUtils

* resove pr comments

---------

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* rag-105-reset-used-budget-cron-job (#44)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add cron job to reset used budget

* rename commonUtils

* resolve pr comments

* Remove trailing slash from vault/agent-out in .gitignore

---------

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* Rag 101 budget check functionality (#45)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* budget check functionality

---------

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* gui running on 3003 issue fixed

* gui running on 3003 issue fixed (#50)

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* added get-configuration.sqpl and updated llmconnections.ts

* Add SQL query to retrieve configuration values

* Hashicorp key saving (#51)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

---------

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* Remove REACT_APP_NOTIFICATION_NODE_URL variable

Removed REACT_APP_NOTIFICATION_NODE_URL environment variable.

* added initil diff identifier functionality

* test phase1

* Refactor inference and connection handling in YAML and TypeScript files

* fixes (#52)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

---------

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* Add entry point script for Vector Indexer with command line interface

* fix (#53)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

* Add entry point script for Vector Indexer with command line interface

---------

Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* diff fixes

* uncomment llm orchestration service in docker compose file

* complete vector indexer

* Add YAML configurations and scripts for managing vault secrets

* Add vault secret management functions and endpoints for LLM connections

* Add Test Production LLM page with messaging functionality and styles

* fixed issue

* fixed merge conflicts

* fixed issue

* fixed issue

* updated with requested chnages

* fixed test ui endpoint request responses schema issue

* fixed dvc path issue

* added dspy optimization

* filters fixed

* refactor: restructure llm_connections table for improved configuration and tracking

* feat: enhance LLM connection handling with AWS and Azure embedding credentials

* fixed issues

* refactor: remove redundant Azure and AWS credential assignments in vault secret functions

* english translation keys added

* et translations

* feat: add internationalization support for budget banner messages in English and Estonian

* Vault Authentication token handling (buerokratt#154) (#70)

* partialy completes prompt refiner

* integrate prompt refiner with llm_config_module

* fixed ruff lint issues

* complete prompt refiner, chunk retriver and reranker

* remove unnesessary comments

* updated .gitignore

* Remove data_sets from tracking

* update .gitignore file

* complete vault setup and response generator

* remove ignore comment

* removed old modules

* fixed merge conflicts

* added initial setup for the vector indexer

* initial llm orchestration service update with context generation

* added new endpoints

* vector indexer with contextual retrieval

* fixed requested changes

* fixed issue

* initial diff identifier setup

* uncommment docker compose file

* added test endpoint for orchestrate service

* fixed ruff linting issue

* Rag 103 budget related schema changes (#41)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

---------



* Rag 93 update connection status (#47)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Implement LLM connection status update functionality with API integration and UI enhancements

---------



* Rag 99 production llm connections logic (#46)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* Add production connection retrieval and update related components

* Implement LLM connection environment update and enhance connection management logic

---------



* Rag 119 endpoint to update used budget (#42)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add functionality to update used budget for LLM connections with validation and response handling

* Implement budget threshold checks and connection deactivation logic in update process

* resolve pr comments

---------



* Rag 113 warning and termination banners (#43)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add budget status check and update BudgetBanner component

* rename commonUtils

* resove pr comments

---------



* rag-105-reset-used-budget-cron-job (#44)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* Add cron job to reset used budget

* rename commonUtils

* resolve pr comments

* Remove trailing slash from vault/agent-out in .gitignore

---------



* Rag 101 budget check functionality (#45)

* Refactor llm_connections table: update budget tracking fields and reorder columns

* Add budget threshold fields and logic to LLM connection management

* Enhance budget management: update budget status logic, adjust thresholds, and improve form handling for LLM connections

* resolve pr comments & refactoring

* rename commonUtils

* budget check functionality

---------



* gui running on 3003 issue fixed

* gui running on 3003 issue fixed (#50)



* added get-configuration.sqpl and updated llmconnections.ts

* Add SQL query to retrieve configuration values

* Hashicorp key saving (#51)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

---------



* Remove REACT_APP_NOTIFICATION_NODE_URL variable

Removed REACT_APP_NOTIFICATION_NODE_URL environment variable.

* added initil diff identifier functionality

* test phase1

* Refactor inference and connection handling in YAML and TypeScript files

* fixes (#52)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

---------



* Add entry point script for Vector Indexer with command line interface

* fix (#53)

* gui running on 3003 issue fixed

* Add SQL query to retrieve configuration values

* Refactor inference and connection handling in YAML and TypeScript files

* Add entry point script for Vector Indexer with command line interface

---------



* diff fixes

* uncomment llm orchestration service in docker compose file

* complete vector indexer

* Add YAML configurations and scripts for managing vault secrets

* Add vault secret management functions and endpoints for LLM connections

* Add Test Production LLM page with messaging functionality and styles

* fixed issue

* fixed merge conflicts

* fixed issue

* fixed issue

* updated with requested chnages

* fixed test ui endpoint request responses schema issue

* fixed dvc path issue

* added dspy optimization

* filters fixed

* refactor: restructure llm_connections table for improved configuration and tracking

* feat: enhance LLM connection handling with AWS and Azure embedding credentials

* fixed issues

* refactor: remove redundant Azure and AWS credential assignments in vault secret functions

* fixed issue

* intial vault setup script

* complete vault authentication handling

* review requested change fix

* fixed issues according to the pr review

* fixed issues in docker compose file relevent to pr review

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>

* translation update

* Add translation for 'overBudget' in budgetStatus

---------

Co-authored-by: Charith Nuwan Bimsara <59943919+nuwangeek@users.noreply.github.com>
Co-authored-by: nuwangeek <charith.bimsara@rootcode.io>
Co-authored-by: erangi-ar <erangika.ariyasena@rootcode.io>
@Thirunayan22
Merge pull request #96 from rootcodelabs/rag-deployment-ec2
bb4da5b 
Deployment updates
@Thirunayan22
Merge branch 'wip' into wip
27f3d91
@Thirunayan22
Merge pull request #97 from buerokratt/wip
f635768 
Pulling changes from Burokratt WIP to rootcodelabs/RAG-Module wip
@Thirunayan22
updated docker compose ec2
b674b5e
@Thirunayan22 Thirunayan22 merged commit 5b66363 into dev Dec 17, 2025
6 of 13 checks passed
@github-actions
Copy link

github-actions bot commented Dec 17, 2025

RAG System Evaluation Report

DeepEval Test Results Summary

Metric Pass Rate Avg Score Status
Overall 0.0% - FAIL
Contextual Precision 0.0% 0.000 FAIL
Contextual Recall 0.0% 0.000 FAIL
Contextual Relevancy 0.0% 0.000 FAIL
Answer Relevancy 0.0% 0.000 FAIL
Faithfulness 0.0% 0.000 FAIL

Total Tests: 20 | Passed: 0 | Failed: 20
Test Duration: 0.3 minutes

Detailed Test Results

| Test | Language | Category | CP | CR | CRel | AR | Faith | Status |
|------|----------|----------|----|----|------|----|----- -|--------|
| 1 | EN | pension_information | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 2 | RU | pension_information | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 3 | ET | family_benefits | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 4 | RU | family_benefits | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 5 | EN | single_parent_support | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 6 | RU | single_parent_support | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 7 | ET | train_services | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 8 | RU | train_services | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 9 | EN | train_services | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 10 | RU | health_cooperation | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 11 | EN | health_cooperation | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 12 | RU | health_cooperation | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 13 | ET | train_services | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 14 | RU | train_services | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 15 | EN | contact_information | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 16 | RU | contact_information | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 17 | RU | single_parent_support | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 18 | RU | single_parent_support | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 19 | RU | pension_information | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |
| 20 | RU | health_cooperation | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | FAIL |

Legend: CP = Contextual Precision, CR = Contextual Recall, CRel = Contextual Relevancy, AR = Answer Relevancy, Faith = Faithfulness
Languages: EN = English, ET = Estonian, RU = Russian

Failed Test Analysis

Test Query Metric Score Issue
1 How flexible will pensions become in 2021? contextual_precision 0.00 Error: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 1234. You can find your ...
1 How flexible will pensions become in 2021? contextual_recall 0.00 Error: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 1234. You can find your ...
1 How flexible will pensions become in 2021? contextual_relevancy 0.00 Error: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 1234. You can find your ...
1 How flexible will pensions become in 2021? answer_relevancy 0.00 Error: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 1234. You can find your ...
1 How flexible will pensions become in 2021? faithfulness 0.00 Error: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 1234. You can find your ...
2 Когда изменятся расчеты пенсионного возраста? contextual_precision 0.00 Error: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 1234. You can find your ...
2 Когда изменятся расчеты пенсионного возраста? contextual_recall 0.00 Error: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 1234. You can find your ...
2 Когда изменятся расчеты пенсионного возраста? contextual_relevancy 0.00 Error: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 1234. You can find your ...
2 Когда изменятся расчеты пенсионного возраста? answer_relevancy 0.00 Error: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 1234. You can find your ...
2 Когда изменятся расчеты пенсионного возраста? faithfulness 0.00 Error: Error code: 401 - {'error': {'message': 'Incorrect API key provided: 1234. You can find your ...

(90 additional failures not shown)

Recommendations

Contextual Precision (Score: 0.000): Consider improving your reranking model or adjusting reranking parameters to better prioritize relevant documents.

Contextual Recall (Score: 0.000): Review your embedding model choice and vector search parameters. Consider domain-specific embeddings.

Contextual Relevancy (Score: 0.000): Optimize chunk size and top-K retrieval parameters to reduce noise in retrieved contexts.

Answer Relevancy (Score: 0.000): Review your prompt template and LLM parameters to improve response relevance to the input query.

Faithfulness (Score: 0.000): Strengthen hallucination detection and ensure the LLM stays grounded in the provided context.

Report generated on 2025-12-17 15:19:28 by DeepEval automated testing pipeline

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@Thirunayan22 @nuwangeek @erangi-ar @ckittask