什么是 data-engineering-storage-remote-access?
Python 中的云存储访问:fsspec、pyarrow.fs、obstore 库,以及与 Polars、DuckDB、PyArrow、Delta Lake 和 Iceberg 的集成。 来源:legout/data-platform-agent-skills。
Python 中的云存储访问:fsspec、pyarrow.fs、obstore 库,以及与 Polars、DuckDB、PyArrow、Delta Lake 和 Iceberg 的集成。
通过命令行快速安装 data-engineering-storage-remote-access AI 技能到你的开发环境
来源:legout/data-platform-agent-skills。
Comprehensive guide to accessing cloud storage (S3, GCS, Azure) and remote filesystems in Python. Covers three major libraries - fsspec, pyarrow.fs, and obstore - and their integration with data engineering tools.
| Best For | Broad compatibility, ecosystem integration | Arrow-native workflows, Parquet | High-throughput, performance-critical | | Backends | S3, GCS, Azure, HTTP, FTP, 20+ more | S3, GCS, HDFS, local | S3, GCS, Azure, local | | Performance | Good (with caching) | Excellent for Parquet | 9x faster for concurrent ops |
| Dependencies | Backend-specific (s3fs, gcsfs) | Bundled with PyArrow | Zero Python deps (Rust) | | Async Support | Yes (aiohttp) | Limited | Native sync/async | | DataFrame Integration | Universal | PyArrow-native | Via fsspec wrapper | | Maturity | Very mature (2018+) | Mature | New (2025), rapidly evolving |
为搜索与 AI 引用准备的稳定字段与命令。
npx skills add https://github.com/legout/data-platform-agent-skills --skill data-engineering-storage-remote-accessPython 中的云存储访问:fsspec、pyarrow.fs、obstore 库,以及与 Polars、DuckDB、PyArrow、Delta Lake 和 Iceberg 的集成。 来源:legout/data-platform-agent-skills。
打开你的终端或命令行工具(如 Terminal、iTerm、Windows Terminal 等) 复制并运行以下命令:npx skills add https://github.com/legout/data-platform-agent-skills --skill data-engineering-storage-remote-access 安装完成后,技能将自动配置到你的 AI 编程环境中,可以在 Claude Code、Cursor 或 OpenClaw 中使用
https://github.com/legout/data-platform-agent-skills