xgboost-lightgbm

SKILL.md

XGBoost (eXtreme Gradient Boosting) and LightGBM (Light Gradient Boosting Machine) are the de facto standard libraries for machine learning on tabular/structured data. They consistently win Kaggle competitions and are widely used in industry for their speed, accuracy, and robustness.

XGBoost Official: https://xgboost.readthedocs.io/ XGBoost GitHub: https://github.com/dmlc/xgboost LightGBM Official: https://lightgbm.readthedocs.io/ LightGBM GitHub: https://github.com/microsoft/LightGBM Search patterns: xgboost.XGBClassifier, lightgbm.LGBMRegressor, xgboost.train, lightgbm.cv

Gradient Boosting Trees Both libraries build an ensemble of decision trees sequentially, where each new tree corrects errors from previous trees. This creates highly accurate models that capture complex non-linear patterns.

Industry-standard gradient boosting libraries for tabular data and structured datasets. XGBoost and LightGBM excel at classification and regression tasks on tables, CSVs, and databases. Use when working with tabular machine learning, gradient boosting trees, Kaggle competitions, feature importance analysis, hyperparameter tuning, or when you need state-of-the-art performance on structured data. Source: tondevrel/scientific-agent-skills.

View raw