feat: Ai experiment planner#265
Open
Vedikajawaria wants to merge 2 commits into
Open
Conversation
Contributor
WalkthroughChangesAI Career Copilot Kit
Documentation and Planning Updates
Suggested reviewers: 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Contributor
:robot_face: AgentKit Structural ValidationNew Contributions Detected
Existing Kits Modified (not allowed in feat: PRs)
Check Results
❌ Errors
|
Contributor
|
Failure recorded at 2026-07-20T10:35:54Z UTC. If this PR is not fixed within 4 weeks it will be automatically closed. |
![coderabbitai[bot]](https://avatars.githubusercontent.com/in/347564?s=60&v=4){kind=small}
Contributor
There was a problem hiding this comment.
Actionable comments posted: 25
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
Inline comments:
In `@kits/ai-experiment-planner/agent.md`:
- Around line 7-17: Update the capability list in the agent instructions to
match the behavior implemented by the ai-experiment-planner flow, which performs
resume, skills, and career analysis rather than AI project planning. Remove the
unrelated project-planning outputs and document the actual analysis capabilities
exposed by the flow.
In `@kits/ai-experiment-planner/flows/ai-experiment-planner.ts`:
- Around line 312-341: The ai-experiment-planner kit is incorrectly copied from
ai-career-copilot and its flow, metadata, references, configuration,
deliverables, and prompts must be aligned with AI/ML experiment planning. In
kits/ai-experiment-planner/flows/ai-experiment-planner.ts#L312-L341, rebuild
references and all node fields for the six stages: dataset-suggestions,
deployment-plan, evaluation-metrics, model-recommendations, project-roadmap, and
tech-stack; in the same file#L1-L159, update the docstring, Flow comment, and
meta.name. Reconcile the documented flow-id environment variable with
kits/ai-experiment-planner/lamatic.config.ts#L19-L25, update
kits/ai-experiment-planner/agent.md#L7-L17 as needed, and replace the unrelated
career prompts in
kits/ai-experiment-planner/prompts/ai-experiment-planner_evaluation-metrics_user.md#L1-L15,
kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_system.md#L1-L5,
kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_user.md#L1-L9,
kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_system.md#L1-L4,
kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_user.md#L1-L16,
kits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_system.md#L1-L4,
and
kits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_user.md#L1-L16
with prompts matching their declared ML planning stages.
In `@kits/ai-experiment-planner/lamatic.config.ts`:
- Around line 19-25: Align the env variable identity used by the step
configuration with the documented deployed flow ID in the ai-experiment-planner
flow. Update the envKey in the steps entry to match the variable named in the
flow header, AGENTIC_GENERATE_CONTENT, and preserve the existing step structure.
In
`@kits/ai-experiment-planner/model-configs/ai-experiment-planner_dataset-suggestions.ts`:
- Around line 1-2: Update the model-config header comment to identify the
Dataset Suggestions stage for the AI Experiment Planner, replacing the copied
“Missing Skills” and “ai-career-copilot” labels. Keep the change limited to the
cover identity comment.
In
`@kits/ai-experiment-planner/model-configs/ai-experiment-planner_deployment-plan.ts`:
- Around line 1-2: Update the model configuration header comment to identify the
Deployment Plan step instead of “Interview Questions” and replace the
ai-career-copilot flow reference with the correct deployment-plan context; leave
the configuration behavior unchanged.
In
`@kits/ai-experiment-planner/model-configs/ai-experiment-planner_evaluation-metrics.ts`:
- Around line 1-2: Update the model configuration header comment to replace the
copied “Readiness Score” and “ai-career-copilot” references with the appropriate
Evaluation Metrics stage and flow details, leaving the configuration
implementation unchanged.
In
`@kits/ai-experiment-planner/model-configs/ai-experiment-planner_model-recommendations.ts`:
- Around line 1-2: Update the header comment in the model configuration to
identify the Experiment Planner’s Model Recommendations instead of the copied
“Career Role Suggestion” and “ai-career-copilot” labels. Leave the configuration
implementation unchanged.
In
`@kits/ai-experiment-planner/model-configs/ai-experiment-planner_project-roadmap.ts`:
- Around line 1-2: Update the flow description comment associated with the
Generate Roadmap model configuration to reference the Project Roadmap stage
instead of the copied `ai-career-copilot` operation, leaving the surrounding
configuration unchanged.
In
`@kits/ai-experiment-planner/model-configs/ai-experiment-planner_tech-stack.ts`:
- Around line 1-2: Update the model configuration header comments to identify
the Tech Stack module for the Experiment Planner, replacing the copied
“Projects” and “ai-career-copilot” labels while preserving the existing config
content.
In
`@kits/ai-experiment-planner/prompts/ai-experiment-planner_dataset-suggestions_system.md`:
- Around line 1-5: Replace the copied career-assistant content with AI
Experiment Planner-specific content across all listed sites. In
kits/ai-experiment-planner/prompts/ai-experiment-planner_dataset-suggestions_system.md
and its user prompt, define dataset suggestions and pass experiment parameters;
in the deployment-plan system and user prompts, generate deployment steps
instead of interview questions; and in the evaluation-metrics system prompt,
define AI evaluation metrics. Update the header comments in
kits/ai-experiment-planner/model-configs/ai-experiment-planner_dataset-suggestions.ts,
ai-experiment-planner_deployment-plan.ts,
ai-experiment-planner_evaluation-metrics.ts,
ai-experiment-planner_model-recommendations.ts,
ai-experiment-planner_project-roadmap.ts, and
ai-experiment-planner_tech-stack.ts to use the specified model-config names and
“Flow: ai-experiment-planner”.
In
`@kits/ai-experiment-planner/prompts/ai-experiment-planner_evaluation-metrics_user.md`:
- Around line 1-15: Rename or replace the content associated with the
evaluation-metrics prompt so it requests AI/ML model evaluation metrics rather
than computing a career readiness score. Remove the user-skills, missing-skills,
target-domain, and readiness_score instructions, and define an output focused on
relevant model evaluation metrics while preserving valid JSON formatting.
In
`@kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_system.md`:
- Around line 1-5: Replace the career-advisor instructions in the
model-recommendations system prompt with guidance for recommending suitable
machine-learning models for the project, including relevant constraints and
outputting only valid JSON. Preserve the prompt’s role as a model-selection
advisor and remove job-role, career, and entry-level wording.
In
`@kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_user.md`:
- Around line 1-9: Update the prompt content in the model-recommendations asset
to request model recommendations rather than suitable job roles, and revise the
expected JSON schema accordingly. Keep the existing user skills and target
domain inputs, ensuring the paired system prompt and this asset use consistent
recommendation semantics.
- Line 4: Use one consistent domain source across the experiment-planner prompt
sequence: update
kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_user.md:4-4
and
kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_user.md:6-6
to reference {{triggerNode_1.output.domain}}, or explicitly document why both
prompts must use codeNode_872's reconstructed domain instead.
In
`@kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_system.md`:
- Around line 1-4: Update the system prompt in
ai-experiment-planner_project-roadmap_system.md to instruct creation of a
practical, step-by-step roadmap for building and executing an AI/ML project,
grounded in the user’s project context, current capabilities, gaps, and target
outcomes. Remove the career-mentor framing and learning-roadmap language while
preserving the requirement to return only valid JSON.
In
`@kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_user.md`:
- Around line 1-16: Revise the roadmap prompt to focus on planning and executing
an AI/ML project rather than helping the user become job-ready, while retaining
the existing skills, missing skills, target domain inputs, concise 5–7-step
structure, actionable guidance, and JSON roadmap output.
In
`@kits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_system.md`:
- Around line 1-4: Update the system prompt content associated with the
tech-stack asset so it instructs the model to recommend a job-ready technology
stack—such as languages, frameworks, tools, and platforms—based on the user's
skills, gaps, and target domain, rather than suggesting projects. Preserve the
requirement to return only valid JSON and align the output with the “Recommended
Tech Stack” deliverable.
In `@kits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_user.md`:
- Around line 1-16: Update the prompt instructions to request a tech-stack
recommendation rather than practical projects, and replace the output schema’s
projects array with the expected tech-stack response structure. Keep the
existing user skill, missing skill, and target domain inputs, and align the
wording with the paired system prompt.
In `@kits/ai-experiment-planner/README.md`:
- Around line 1-3: Restore each README’s correct kit identity: update
kits/ai-experiment-planner/README.md lines 1-3 to use the AI Experiment Planner
title and feature description, and update
kits/ai-interview-preparation-agent/README.md lines 1-3 to restore the AI
Interview Preparation Agent title and introduction. Ensure the
experiment-planner content remains with its own kit.
- Around line 53-65: Update the README environment setup and deployment sections
to use the required LAMATIC_FLOW_ID variable instead of AGENTIC_GENERATE_CONTENT
and any hard-coded flow ID. Ensure all examples consistently reference the
configured flow environment key declared by lamatic.config.ts.
- Line 6: Update the README Markdown around the Live Demo heading and the
referenced sections to satisfy linting: add required blank lines around
headings, use consistent ordered-list prefixes, and annotate every remaining
fenced code block with an appropriate language, using text for plain text or
path examples.
- Around line 40-65: Correct the README setup instructions to consistently
reference the ai-experiment-planner kit, including the clone destination and cd
path, and replace the incorrect app/components/actions project-structure
references with the kit’s actual flows, model-configs, and prompts directories.
Apply these path corrections across all setup and project-structure sections
covered by the review.
In `@kits/ai-interview-preparation-agent/README.md`:
- Around line 33-35: Update the fenced input example in the README to declare an
appropriate language, and ensure the file ends with exactly one trailing
newline. Do not alter the example content or surrounding documentation.
- Around line 29-44: Update the README Example output to match the deployed flow
response fields: skills, missing_skills, roles, readiness_score, roadmap,
projects, and interview_questions. Remove the unrelated promised sections, or
update the flow contract to return them, while keeping the documented example
consistent with the actual response.
In `@planning/project-plan.md`:
- Line 29: Add exactly one trailing newline at the end of
planning/project-plan.md, without changing its content.
🪄 Autofix (Beta)
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: Repository UI (base), Organization UI (inherited)
Review profile: ASSERTIVE
Plan: Pro
Run ID: 340c4240-363b-4690-845f-1827c64b0ab5
📒 Files selected for processing (26)
kits/ai-experiment-planner/.gitignorekits/ai-experiment-planner/README.mdkits/ai-experiment-planner/agent.mdkits/ai-experiment-planner/constitutions/default.mdkits/ai-experiment-planner/flows/ai-experiment-planner.tskits/ai-experiment-planner/lamatic.config.tskits/ai-experiment-planner/model-configs/ai-experiment-planner_dataset-suggestions.tskits/ai-experiment-planner/model-configs/ai-experiment-planner_deployment-plan.tskits/ai-experiment-planner/model-configs/ai-experiment-planner_evaluation-metrics.tskits/ai-experiment-planner/model-configs/ai-experiment-planner_model-recommendations.tskits/ai-experiment-planner/model-configs/ai-experiment-planner_project-roadmap.tskits/ai-experiment-planner/model-configs/ai-experiment-planner_tech-stack.tskits/ai-experiment-planner/prompts/ai-experiment-planner_dataset-suggestions_system.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_dataset-suggestions_user.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_deployment-plan_system.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_deployment-plan_user.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_evaluation-metrics_system.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_evaluation-metrics_user.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_system.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_user.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_system.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_user.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_system.mdkits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_user.mdkits/ai-interview-preparation-agent/README.mdplanning/project-plan.md
Comment on lines
+7
to
+17
| Whenever the user provides an AI project idea, generate: | ||
|
|
||
| 1. Problem Understanding | ||
| 2. Recommended Tech Stack | ||
| 3. Dataset Suggestions | ||
| 4. Model Recommendations | ||
| 5. Folder Structure | ||
| 6. Evaluation Metrics | ||
| 7. Deployment Plan | ||
| 8. Timeline | ||
| 9. Future Improvements |
Contributor
There was a problem hiding this comment.
🗄️ Data Integrity & Integration | 🟠 Major
Briefing doesn't match the mission, agent. This capability list (tech stack, datasets, folder structure, timeline...) doesn't match what flows/ai-experiment-planner.ts actually executes (resume/skills/career analysis). Deferred to the cross-file consolidation below.
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In `@kits/ai-experiment-planner/agent.md` around lines 7 - 17, Update the
capability list in the agent instructions to match the behavior implemented by
the ai-experiment-planner flow, which performs resume, skills, and career
analysis rather than AI project planning. Remove the unrelated project-planning
outputs and document the actual analysis capabilities exposed by the flow.
Comment on lines
+312
to
+341
| export const references = { | ||
| "constitutions": { | ||
| "default": "@constitutions/default.md" | ||
| }, | ||
| "prompts": { | ||
| "ai_career_copilot_missing_skills_system": "@prompts/ai-career-copilot_missing-skills_system.md", | ||
| "ai_career_copilot_missing_skills_user": "@prompts/ai-career-copilot_missing-skills_user.md", | ||
| "ai_career_copilot_career_role_suggestion_system": "@prompts/ai-career-copilot_career-role-suggestion_system.md", | ||
| "ai_career_copilot_career_role_suggestion_user": "@prompts/ai-career-copilot_career-role-suggestion_user.md", | ||
| "ai_career_copilot_readiness_score_system": "@prompts/ai-career-copilot_readiness-score_system.md", | ||
| "ai_career_copilot_readiness_score_user": "@prompts/ai-career-copilot_readiness-score_user.md", | ||
| "ai_career_copilot_generate_roadmap_system": "@prompts/ai-career-copilot_generate-roadmap_system.md", | ||
| "ai_career_copilot_generate_roadmap_user": "@prompts/ai-career-copilot_generate-roadmap_user.md", | ||
| "ai_career_copilot_projects_system": "@prompts/ai-career-copilot_projects_system.md", | ||
| "ai_career_copilot_projects_user": "@prompts/ai-career-copilot_projects_user.md", | ||
| "ai_career_copilot_interview_questions_system": "@prompts/ai-career-copilot_interview-questions_system.md", | ||
| "ai_career_copilot_interview_questions_user": "@prompts/ai-career-copilot_interview-questions_user.md" | ||
| }, | ||
| "scripts": { | ||
| "ai_career_copilot_skills_extraction": "@scripts/ai-career-copilot_skills-extraction.ts" | ||
| }, | ||
| "modelConfigs": { | ||
| "ai_career_copilot_missing_skills": "@model-configs/ai-career-copilot_missing-skills.ts", | ||
| "ai_career_copilot_career_role_suggestion": "@model-configs/ai-career-copilot_career-role-suggestion.ts", | ||
| "ai_career_copilot_readiness_score": "@model-configs/ai-career-copilot_readiness-score.ts", | ||
| "ai_career_copilot_generate_roadmap": "@model-configs/ai-career-copilot_generate-roadmap.ts", | ||
| "ai_career_copilot_projects": "@model-configs/ai-career-copilot_projects.ts", | ||
| "ai_career_copilot_interview_questions": "@model-configs/ai-career-copilot_interview-questions.ts" | ||
| } | ||
| }; |
Contributor
There was a problem hiding this comment.
🗄️ Data Integrity & Integration | 🔴 Critical | 🏗️ Heavy lift
Agent, your mission — should you choose to accept it — is to figure out which kit this actually is. Every file below shares one root cause: this kit's flow, its own docstring/meta, and all six prompt files were lifted from an unrelated "ai-career-copilot" kit (resume/skills/job-role/readiness/roadmap/interview-prep content) without renaming or adapting anything to match the declared "ai-experiment-planner" purpose (AI/ML tech stack, datasets, model choice, eval metrics, deployment — per agent.md/lamatic.config.ts). Concretely, the flow's own header even contradicts itself (Flow: ai-experiment-planner at line 2 vs Flow: ai-career-copilot at line 148), and none of its six InstructorLLMNode/codeNode references resolve to any asset that actually exists in this kit.
kits/ai-experiment-planner/flows/ai-experiment-planner.ts#L312-L341: rewrite thereferencesblock (and the corresponding nodeprompts/memories/messages/attachments/generativeModelName/codefields) to point at the actual delivered assets, or replace this flow entirely with one whose stages matchai-experiment-planner_{dataset-suggestions,deployment-plan,evaluation-metrics,model-recommendations,project-roadmap,tech-stack}.kits/ai-experiment-planner/flows/ai-experiment-planner.ts#L1-L159: rewrite the docstring,// Flow:comment, andmeta.nameto describe the AI/ML experiment-planning flow this kit is supposed to ship, not the career-copilot one.kits/ai-experiment-planner/lamatic.config.ts#L19-L25: reconcileenvKey: "LAMATIC_FLOW_ID"with whatever the corrected flow doc actually documents as the flow-id env var.kits/ai-experiment-planner/agent.md#L7-L17: keep or revise this deliverable list once the flow is rebuilt to match it.kits/ai-experiment-planner/prompts/ai-experiment-planner_evaluation-metrics_user.md#L1-L15: replace with an actual ML evaluation-metrics prompt (accuracy/F1/etc.), or rename/repurpose if this readiness-score content is intentionally kept.kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_system.md#L1-L5: replace with an ML model-recommendation prompt, not a career-advisor job-role prompt.kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_user.md#L1-L9: same fix as its paired system prompt.kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_system.md#L1-L4: reframe as an AI/ML project execution roadmap rather than a personal career-learning roadmap.kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_user.md#L1-L16: same fix as its paired system prompt.kits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_system.md#L1-L4: replace with a technology-stack recommendation prompt; current content produces a "projects" list, not a stack.kits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_user.md#L1-L16: same fix as its paired system prompt.
📍 Affects 10 files
kits/ai-experiment-planner/flows/ai-experiment-planner.ts#L312-L341(this comment)kits/ai-experiment-planner/flows/ai-experiment-planner.ts#L1-L159kits/ai-experiment-planner/lamatic.config.ts#L19-L25kits/ai-experiment-planner/agent.md#L7-L17kits/ai-experiment-planner/prompts/ai-experiment-planner_evaluation-metrics_user.md#L1-L15kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_system.md#L1-L5kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_user.md#L1-L9kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_system.md#L1-L4kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_user.md#L1-L16kits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_system.md#L1-L4kits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_user.md#L1-L16
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In `@kits/ai-experiment-planner/flows/ai-experiment-planner.ts` around lines 312 -
341, The ai-experiment-planner kit is incorrectly copied from ai-career-copilot
and its flow, metadata, references, configuration, deliverables, and prompts
must be aligned with AI/ML experiment planning. In
kits/ai-experiment-planner/flows/ai-experiment-planner.ts#L312-L341, rebuild
references and all node fields for the six stages: dataset-suggestions,
deployment-plan, evaluation-metrics, model-recommendations, project-roadmap, and
tech-stack; in the same file#L1-L159, update the docstring, Flow comment, and
meta.name. Reconcile the documented flow-id environment variable with
kits/ai-experiment-planner/lamatic.config.ts#L19-L25, update
kits/ai-experiment-planner/agent.md#L7-L17 as needed, and replace the unrelated
career prompts in
kits/ai-experiment-planner/prompts/ai-experiment-planner_evaluation-metrics_user.md#L1-L15,
kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_system.md#L1-L5,
kits/ai-experiment-planner/prompts/ai-experiment-planner_model-recommendations_user.md#L1-L9,
kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_system.md#L1-L4,
kits/ai-experiment-planner/prompts/ai-experiment-planner_project-roadmap_user.md#L1-L16,
kits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_system.md#L1-L4,
and
kits/ai-experiment-planner/prompts/ai-experiment-planner_tech-stack_user.md#L1-L16
with prompts matching their declared ML planning stages.
Comment on lines
+19
to
+25
| steps: [ | ||
| { | ||
| id: "ai-experiment-planner", | ||
| type: "mandatory", | ||
| envKey: "LAMATIC_FLOW_ID" | ||
| } | ||
| ], |
Contributor
There was a problem hiding this comment.
🗄️ Data Integrity & Integration | 🟠 Major
Your cover story doesn't match your paperwork, agent. envKey here is LAMATIC_FLOW_ID, but the flow's own doc header (flows/ai-experiment-planner.ts) names AGENTIC_GENERATE_CONTENT as the env var that "stores the deployed flow ID." Pick one identity before deployment.
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In `@kits/ai-experiment-planner/lamatic.config.ts` around lines 19 - 25, Align the
env variable identity used by the step configuration with the documented
deployed flow ID in the ai-experiment-planner flow. Update the envKey in the
steps entry to match the variable named in the flow header,
AGENTIC_GENERATE_CONTENT, and preserve the existing step structure.
Comment on lines
+1
to
+2
| // Model config: Missing Skills (InstructorLLMNode) | ||
| // Flow: ai-career-copilot |
Contributor
There was a problem hiding this comment.
📐 Maintainability & Code Quality | 🟠 Major | ⚡ Quick win
Fix copy-paste artifact in model config.
Agent, we have a situation. Your mission, should you choose to accept it, is to update this config's cover identity. It's currently masquerading as the "Missing Skills" stage from the ai-career-copilot flow instead of the Dataset Suggestions stage for the Experiment Planner.
🕵️ Proposed cover update
-// Model config: Missing Skills (InstructorLLMNode)
-// Flow: ai-career-copilot
+// Model config: Dataset Suggestions (InstructorLLMNode)
+// Flow: ai-experiment-planner📝 Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.
Suggested change
| // Model config: Missing Skills (InstructorLLMNode) | |
| // Flow: ai-career-copilot | |
| // Model config: Dataset Suggestions (InstructorLLMNode) | |
| // Flow: ai-experiment-planner |
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In
`@kits/ai-experiment-planner/model-configs/ai-experiment-planner_dataset-suggestions.ts`
around lines 1 - 2, Update the model-config header comment to identify the
Dataset Suggestions stage for the AI Experiment Planner, replacing the copied
“Missing Skills” and “ai-career-copilot” labels. Keep the change limited to the
cover identity comment.
Comment on lines
+1
to
+2
| // Model config: Interview Questions (InstructorLLMNode) | ||
| // Flow: ai-career-copilot |
Contributor
There was a problem hiding this comment.
📐 Maintainability & Code Quality | 🟠 Major | ⚡ Quick win
Fix copy-paste artifact in model config.
Agent, your mission, should you choose to accept it, is to correct this file's intel. It still identifies as the "Interview Questions" step from the ai-career-copilot operation. We need it updated for the Deployment Plan.
🕵️ Proposed cover update
-// Model config: Interview Questions (InstructorLLMNode)
-// Flow: ai-career-copilot
+// Model config: Deployment Plan (InstructorLLMNode)
+// Flow: ai-experiment-planner📝 Committable suggestion
‼️ IMPORTANT
Carefully review the code before committing. Ensure that it accurately replaces the highlighted code, contains no missing lines, and has no issues with indentation. Thoroughly test & benchmark the code to ensure it meets the requirements.
Suggested change
| // Model config: Interview Questions (InstructorLLMNode) | |
| // Flow: ai-career-copilot | |
| // Model config: Deployment Plan (InstructorLLMNode) | |
| // Flow: ai-experiment-planner |
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In
`@kits/ai-experiment-planner/model-configs/ai-experiment-planner_deployment-plan.ts`
around lines 1 - 2, Update the model configuration header comment to identify
the Deployment Plan step instead of “Interview Questions” and replace the
ai-career-copilot flow reference with the correct deployment-plan context; leave
the configuration behavior unchanged.
Comment on lines
+40
to
+65
| 1. **Clone the repository** | ||
|
|
||
| ```bash | ||
| git clone https://github.com/Lamatic/AgentKit.git | ||
| cd AgentKit/kits/assistant/ai-career-copilot | ||
| ``` | ||
|
|
||
| 2. **Install dependencies** | ||
|
|
||
| ```bash | ||
| npm install | ||
| ``` | ||
|
|
||
| 3. **Setup environment variables** | ||
|
|
||
| ```bash | ||
| cp .env.example .env | ||
| ``` | ||
|
|
||
| 4. **Add your Lamatic credentials in `.env`** | ||
|
|
||
| ```env | ||
| LAMATIC_API_KEY=YOUR_API_KEY | ||
| LAMATIC_PROJECT_ID=YOUR_PROJECT_ID | ||
| LAMATIC_API_URL=YOUR_API_URL | ||
| AGENTIC_GENERATE_CONTENT=YOUR_FLOW_ID |
Contributor
There was a problem hiding this comment.
🎯 Functional Correctness | 🟠 Major | ⚡ Quick win
Correct the installation and project paths before merge.
The documented paths point to kits/assistant/ai-career-copilot, while the reviewed kit is kits/ai-experiment-planner/. The project structure also lists app/, components/, and actions/ instead of the supplied kit assets such as flows/, model-configs/, and prompts/. Following these instructions leads users to the wrong directory and files.
Suggested correction
-cd AgentKit/kits/assistant/ai-career-copilot
+cd AgentKit/kits/ai-experiment-planner
...
-kits/assistant/ai-career-copilot
+kits/ai-experiment-plannerAlso applies to: 92-104, 115-123
🧰 Tools
🪛 markdownlint-cli2 (0.23.0)
[warning] 47-47: Ordered list item prefix
Expected: 1; Actual: 2; Style: 1/1/1
(MD029, ol-prefix)
[warning] 53-53: Ordered list item prefix
Expected: 1; Actual: 3; Style: 1/1/1
(MD029, ol-prefix)
[warning] 59-59: Ordered list item prefix
Expected: 1; Actual: 4; Style: 1/1/1
(MD029, ol-prefix)
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In `@kits/ai-experiment-planner/README.md` around lines 40 - 65, Correct the
README setup instructions to consistently reference the ai-experiment-planner
kit, including the clone destination and cd path, and replace the incorrect
app/components/actions project-structure references with the kit’s actual flows,
model-configs, and prompts directories. Apply these path corrections across all
setup and project-structure sections covered by the review.
Comment on lines
+53
to
+65
| 3. **Setup environment variables** | ||
|
|
||
| ```bash | ||
| cp .env.example .env | ||
| ``` | ||
|
|
||
| 4. **Add your Lamatic credentials in `.env`** | ||
|
|
||
| ```env | ||
| LAMATIC_API_KEY=YOUR_API_KEY | ||
| LAMATIC_PROJECT_ID=YOUR_PROJECT_ID | ||
| LAMATIC_API_URL=YOUR_API_URL | ||
| AGENTIC_GENERATE_CONTENT=YOUR_FLOW_ID |
Contributor
There was a problem hiding this comment.
🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win
Use the configured flow environment key.
lamatic.config.ts declares LAMATIC_FLOW_ID as the mandatory environment key, but this README instructs users to set AGENTIC_GENERATE_CONTENT and separately presents a hard-coded flow ID. Update the setup and deployment sections to document LAMATIC_FLOW_ID consistently.
Also applies to: 108-110
🧰 Tools
🪛 markdownlint-cli2 (0.23.0)
[warning] 53-53: Ordered list item prefix
Expected: 1; Actual: 3; Style: 1/1/1
(MD029, ol-prefix)
[warning] 59-59: Ordered list item prefix
Expected: 1; Actual: 4; Style: 1/1/1
(MD029, ol-prefix)
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In `@kits/ai-experiment-planner/README.md` around lines 53 - 65, Update the README
environment setup and deployment sections to use the required LAMATIC_FLOW_ID
variable instead of AGENTIC_GENERATE_CONTENT and any hard-coded flow ID. Ensure
all examples consistently reference the configured flow environment key declared
by lamatic.config.ts.
Comment on lines
+29
to
+44
| ## Example | ||
|
|
||
| ### Skill Gap Detection | ||
| ### Input | ||
|
|
||
| Compares resume content against job requirements. | ||
|
|
||
| ### Tailored Interview Questions | ||
|
|
||
| Generates role-specific technical and behavioral questions. | ||
|
|
||
| ### Interview Preparation Guidance | ||
|
|
||
| Provides ideal answer directions for each question. | ||
|
|
||
| ## Input | ||
|
|
||
| ```json | ||
| { | ||
| "resumeText": "...", | ||
| "jobDescription": "..." | ||
| } | ||
| ``` | ||
|
|
||
| ## Output | ||
|
|
||
| ```json | ||
| { | ||
| "strengths": [], | ||
| "gaps": [], | ||
| "questions": [] | ||
| } | ||
| Build a fake currency detection system. | ||
| ``` | ||
|
|
||
| ## Technology | ||
|
|
||
| * Lamatic AgentKit | ||
| * Gemini / LLM Models | ||
| * Structured JSON Output | ||
|
|
||
| ## Demo Video | ||
|
|
||
| Watch the demo here: | ||
|
|
||
| https://drive.google.com/file/d/1Da8nCZi_T6x1yJvCoDAsLesAXbICV1mh/view?usp=drive_link | ||
|
|
||
| ## Screenshots | ||
|
|
||
| ### Home Screen | ||
|
|
||
|  | ||
| ### Output | ||
|
|
||
| - Problem Breakdown | ||
| - Dataset Suggestions | ||
| - Recommended Models | ||
| - Folder Structure | ||
| - Deployment Strategy | ||
| - Future Improvements |
Contributor
There was a problem hiding this comment.
🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win
Align the example output with the deployed flow response.
The flow maps skills, missing_skills, roles, readiness_score, roadmap, projects, and interview_questions; this README instead promises problem breakdown, dataset suggestions, models, folder structure, deployment strategy, and future improvements. Update the example or change the flow contract so users are not promised fields they will not receive.
🧰 Tools
🪛 markdownlint-cli2 (0.23.0)
[warning] 33-33: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In `@kits/ai-interview-preparation-agent/README.md` around lines 29 - 44, Update
the README Example output to match the deployed flow response fields: skills,
missing_skills, roles, readiness_score, roadmap, projects, and
interview_questions. Remove the unrelated promised sections, or update the flow
contract to return them, while keeping the documented example consistent with
the actual response.
Comment on lines
33
to
35
| ``` | ||
|
|
||
| ## Output | ||
|
|
||
| ```json | ||
| { | ||
| "strengths": [], | ||
| "gaps": [], | ||
| "questions": [] | ||
| } | ||
| Build a fake currency detection system. | ||
| ``` |
Contributor
There was a problem hiding this comment.
📐 Maintainability & Code Quality | 🔵 Trivial | ⚡ Quick win
Resolve the remaining Markdown lint warnings.
Specify a language for the fenced input example and ensure the file ends with exactly one newline.
Also applies to: 48-48
🧰 Tools
🪛 markdownlint-cli2 (0.23.0)
[warning] 33-33: Fenced code blocks should have a language specified
(MD040, fenced-code-language)
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In `@kits/ai-interview-preparation-agent/README.md` around lines 33 - 35, Update
the fenced input example in the README to declare an appropriate language, and
ensure the file ends with exactly one trailing newline. Do not alter the example
content or surrounding documentation.
Source: Linters/SAST tools
| - Good First Issue Finder | ||
| - Tech Stack Detection | ||
| - Difficulty Estimation | ||
| - Setup Guide No newline at end of file |
Contributor
There was a problem hiding this comment.
📐 Maintainability & Code Quality | 🟡 Minor | ⚡ Quick win
Mission note: add the final newline.
End the file with exactly one trailing newline so markdownlint MD047 passes cleanly.
🧰 Tools
🪛 markdownlint-cli2 (0.23.0)
[warning] 29-29: Files should end with a single newline character
(MD047, single-trailing-newline)
🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
In `@planning/project-plan.md` at line 29, Add exactly one trailing newline at the
end of planning/project-plan.md, without changing its content.
Source: Linters/SAST tools
Contributor
|
Hi @Vedikajawaria! 👋 Before this PR can be reviewed by maintainers, please resolve all comments and requested changes from the CodeRabbit automated review. Steps to follow:
This helps keep the review process efficient for everyone. Thank you! 🙏 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
PR Checklist
1. Select Contribution Type
kits/<category>/<kit-name>/)bundles/<bundle-name>/)templates/<template-name>/)2. General Requirements
kebab-caseand matches the flow IDREADME.md(purpose, setup, usage)3. File Structure (Check what applies)
config.jsonpresent with valid metadata (name, description, tags, steps, author, env keys)flows/<flow-name>/(where applicable) include:config.json(Lamatic flow export)inputs.jsonmeta.jsonREADME.md.env.examplewith placeholder values only (kits only)config.jsonnode graphs (changes via Lamatic Studio export)4. Validation
npm install && npm run devworks locally (kits: UI runs; bundles/templates: flows are valid)[kit] Add <name> for <use case>)InstructorLLMNodestages to generate missing skills, role suggestions, readiness score, learning roadmap, project ideas, and interview questions.