Skip to content
anyai.fyi

aidp-spark-optimization

Skill from oracle-samples/oracle-aidp-samples

Frontend & UI No risky patterns found curated uicodenotebookmemory

Install

npx skills add oracle-samples/oracle-aidp-samples --skill aidp-spark-optimization

Runs the open skills CLI and installs the skill for your agent (Claude Code, Codex, Cursor …). Alternatively copy the skill folder into .claude/skills/ or upload it in Claude.ai under Settings → Skills.

As a Claude Code plugin

/plugin marketplace add anthropics/claude-plugins-official /plugin install oracle-ai-data-platform-workbench-spark-connectors@claude-plugins-official

This skill is part of the plugin “oracle-ai-data-platform-workbench-spark-connectors”. In Claude Code the plugin installs it together with the plugin’s other skills, commands and hooks.

What does the aidp-spark-optimization skill do?

Use when a Spark job/notebook is slow, missing an SLA, spilling, OOMing, generating too many small files, or shuffling/skewing heavily; when reviewing Spark/PySpark code or a Spark UI for performance; or before running a large Spark workload. Covers open-source Apache Spark 3.5.0 (+ Delta Lake) tuning -- partitions, shuffle, joins, skew, file layout, memory, codegen, caching, AQE, compression, and configuration.

Description from the SKILL.md in the source repository.

Questions about aidp-spark-optimization

What does the aidp-spark-optimization skill do?

Use when a Spark job/notebook is slow, missing an SLA, spilling, OOMing, generating too many small files, or shuffling/skewing heavily; when reviewing Spark/PySpark code or a Spark UI for performance; or before running a large Spark workload. Covers open-source Apache Spark 3.5.0 (+ Delta Lake) tuning -- partitions, shuffle, joins, skew, file layout, memory, codegen, caching, AQE, compression, and configuration.

How do I install aidp-spark-optimization?

In a terminal: npx skills add oracle-samples/oracle-aidp-samples --skill aidp-spark-optimization. The skills CLI asks which agents to install it for. In Claude.ai you can upload the skill folder as a ZIP under Settings → Skills.

Which agents can use aidp-spark-optimization?

Skills use the open SKILL.md format, which Claude Code, Claude.ai, the Claude API, OpenAI Codex, Cursor, Gemini CLI and other agents support.

Is aidp-spark-optimization safe to use?

Our automatic check found no risky patterns (piped shell scripts, hidden characters, secret access, prompt overrides). It is not a full audit – read the SKILL.md and any scripts before installing.

More skills from oracle-samples/oracle-aidp-samples

analytics
oracle-samples/oracle-aidp-samples

Use this Oracle Analytics domain skill when creating or editing Oracle Analytics Cloud workbooks, visualizations, calculations, filters, layouts, governed analyses, or when routing an analytics request to a more specific nested skill.

Data & Databases curated
No risky patterns found
migration-status
oracle-samples/oracle-aidp-samples

Parse and summarize the JOB_REPORT.md produced by a prior migration run. Surfaces cell pass/fail/fix counts per task, lists the failing cells, and recommends a next-step skill (fixup-cell, resume, or all-clear). Use after any aidp-migrate-job run, or when the user asks "how did the migration go", "what failed", "did it pass".

Research & Web curated
No risky patterns found
migration-reviewer
oracle-samples/oracle-aidp-samples

Review a migrated .ipynb for correctness — NOT just "did it run". Catches latent issues the cell-execute loop missed — wrong write-mode, lost rows, dropped columns, hardcoded paths, dead Databricks-isms, builtins shadowing, format downgrades. Outputs a structured Blockers / Important / Style / Good review report. Use after aidp-migrate-job completes, especially on the first few notebooks of a new workload before scaling out.

Development curated
No risky patterns found
migrate-job-flow
oracle-samples/oracle-aidp-samples

Guided full-job migration flow. Walks the user from "I want to migrate this Databricks job" through DAG → data check → migrate → status, asking before each phase. Composes aidp-build-dag, aidp-check-data, aidp-migrate-job, and migration-status. Use when the user wants the end-to-end guided experience instead of running individual phases manually.

Data & Databases curated
No risky patterns found
migrate-catalog-flow
oracle-samples/oracle-aidp-samples

Guided catalog migration flow. Extracts Databricks Unity Catalog / HMS metadata, previews the 18-rule DDL rewrite, then batched replay on AIDP. Asks before the destructive replay step. Use when the user wants to migrate the catalog layer (schemas + tables) with checkpoints, rather than running aidp-migrate-catalog directly.

Other curated
No risky patterns found
databricks-notebook-analyzer
oracle-samples/oracle-aidp-samples

Read a single Databricks notebook (.ipynb / .py / .scala source format) and produce a migration-readiness report — what it does, what it depends on, what risks the migrator will hit, which gotchas (from references/gotchas.md) will apply. Run before manually authoring an entry in a migration manifest, OR as a one-off "should we migrate this?" assessment. Read-only — does not modify the notebook and does not invoke the migrator.

Data & Databases curated
No risky patterns found
check-data-flow
oracle-samples/oracle-aidp-samples

Pre-migration data-availability scan. Reads a migration manifest, probes every spark.read.* / saveAsTable target on the AIDP cluster, reports OK / MISSING / EMPTY with remediation tips per category. Use before any aidp-migrate-job run, or whenever the user asks "is the data ready?", "pre-migration check", "what's missing on AIDP".

Data & Databases curated
No risky patterns found
aidp-streaming-kafka
oracle-samples/oracle-aidp-samples

Consume an OCI Streaming stream from an AIDP notebook via Spark structured streaming (Kafka-compat). Use when the user mentions OCI Streaming, Kafka on OCI, stream pool, structured streaming, or wants to read Kafka messages into Spark. Auth is SASL/PLAIN with an OCI auth token. Pattern matches the official Oracle AIDP sample.

Data & Databases curated
No risky patterns found

Related skills in Frontend & UI

frontend-design
anthropics/skills

Guidance for distinctive, intentional visual design when building new UI or reshaping an existing one. Helps with aesthetic direction, typography, and making choices that don't read as templated defaults.

Frontend & UI 1086k installs curated
No risky patterns found
prototype
mattpocock/skills

Build a throwaway prototype to answer a design question. Use when the user wants to sanity-check whether a state model or logic feels right, or explore what a UI should look like.

Frontend & UI 1050k installs curated
No risky patterns found
vercel-react-best-practices
vercel-labs/agent-skills

React and Next.js performance optimization guidelines from Vercel Engineering. This skill should be used when writing, reviewing, or refactoring React/Next.js code to ensure optimal performance patterns. Triggers on tasks involving React components, Next.js pages, data fetching, bundle optimization, or performance improvements.

Frontend & UI 878k installs curated
No risky patterns found
web-design-guidelines
vercel-labs/agent-skills

Review UI code for Web Interface Guidelines compliance. Use when asked to "review my UI", "check accessibility", "audit design", "review UX", or "check my site against best practices".

Frontend & UI 834k installs curated
No risky patterns found
vercel-composition-patterns
vercel-labs/agent-skills

React composition patterns that scale. Use when refactoring components with boolean prop proliferation, building flexible component libraries, or designing reusable APIs. Triggers on tasks involving compound components, render props, context providers, or component architecture. Includes React 19 API changes.

Frontend & UI 442k installs curated
No risky patterns found
vercel-react-native-skills
vercel-labs/agent-skills

React Native and Expo best practices for building performant mobile apps. Use when building React Native components, optimizing list performance, implementing animations, or working with native modules. Triggers on tasks involving React Native, Expo, mobile performance, or native platform APIs.

Frontend & UI 269k installs curated
No risky patterns found
vercel-react-view-transitions
vercel-labs/agent-skills

Guide for implementing smooth, native-feeling animations using React's View Transition API (`<ViewTransition>` component, `addTransitionType`, and CSS view transition pseudo-elements). Use this skill whenever the user wants to add page transitions, animate route changes, create shared element animations, animate enter/exit of components, animate list reorder, implement directional (forward/back) navigation animations, or integrate view transitions in Next.js. Also use when the user mentions view transitions, `startViewTransition`, `ViewTransition`, transition types, or asks about animating between UI states in React without third-party animation libraries.

Frontend & UI 183k installs curated
No risky patterns found
web-artifacts-builder
anthropics/skills

Suite of tools for creating elaborate, multi-component claude.ai HTML artifacts using modern frontend web technologies (React, Tailwind CSS, shadcn/ui). Use for complex artifacts requiring state management, routing, or shadcn/ui components - not for simple single-file HTML/JSX artifacts.

Frontend & UI 117k installs curated
No risky patterns found