<p>The project, Insurance Pricing Forecast Using XGBoost Regressor focuses on leveraging machine learning to accurately predict healthcare costs for insurance companies. This helps insurance companies forecast future expenses. The goal is to set accurate premiums. Insurance companies need accurate methods to forecast future expenses. This helps them set premiums profitably. Traditional methods often struggle with complex data interactions. Machine learning, especially XGBoost, offers a valuable solution. This project develops a machine learning model. It helps insurers establish rates based on features like age, BMI, and smoking status. The goal is to ensure profitability while providing fair coverage.</p>

Predict healthcare costs with XGBoost Regressor. This machine learning model forecasts expenses using factors like age, BMI, and smoking status to help insurance firms set prices.

This project builds an XGBoost Regressor to predict healthcare costs, ensuring insurance profitability. We'll compare it with a linear regression baseline and learn to communicate results effectively to non-technical stakeholders.

Insurance Pricing Forecast Using XGBoost Regressor

<h2><strong>Project Overview</strong></h2>
<p>In this project, we build a machine learning model using XGBoost Regressor. This XGBoost Regressor predicts healthcare expenses. It considers factors like age, BMI, smoking status, and region. These factors help estimate healthcare costs accurately. We also build a linear regression model as a baseline for comparison. By the end of this project, insurance companies will have a reliable tool. This tool helps set premiums based on predicted expenses. It reduces reliance on manual calculations and improves profitability.</p>

<br><h2><strong>Prerequisites</strong></h2>
<p>Before starting this project, understand Python, statistics, and machine learning. Familiarity with libraries like NumPy, Pandas, Matplotlib, and Scikit-learn. These libraries help with data manipulation, visualization, and model building. Also, be familiar with XGBoost Regressor, linear regression, and regression analysis. This knowledge will help you understand the modeling process.</p>

<br><h2><strong>Approach</strong></h2>
<p>We focus on building an XGBoost Regressor to predict healthcare costs. The model uses several features for forecasting. Additionally, we will compare this XGBoost Regressor with a linear regression model. This comparison helps evaluate the model's effectiveness. We select the XGBoost Regressor for its ability to handle non-linear relationships. Furthermore, the XGBoost Regressor excels with complex datasets. It provides high predictive power and efficiency. Although other machine learning techniques could be used, the XGBoost Regressor stands out.</p>

<br><h2><strong>Workflow and Methodology</strong></h2>
<h3><strong>The overall workflow of this project includes:</strong></h3>
<ul>
  <li>
    <p>Problem Definition: Predict healthcare expenses using various features like age and smoking status.</p>
  </li>
  <li>
    <p>Data Collection: Gather data from healthcare records, including patient demographics and medical expenses.</p>
  </li>
  <li>
    <p>Data Preparation: Clean, transform, and encode the data for modeling.</p>
  </li>
  <li>
    <p>Modeling: Build a baseline linear regression model first. Then, use an XGBoost regressor to achieve better accuracy.</p>
  </li>
  <li>
    <p>Evaluation: Use evaluation metrics to assess model performance. Check Root Mean Squared Error (RMSE). Also, calculate Mean Absolute Percentage Error (MAPE).</p>
  </li>
  <li>
    <p>Conclusion: Analyze results and finalize the best model for predicting healthcare expenses.

</p>
  </li>
</ul>
<h3><strong>The methodology involves</strong></h3>
<ul>
  <li>
    <p>Exploratory Data Analysis (EDA): Understanding feature distributions, correlations, and trends in the data.</p>
  </li>
  <li>
    <p>Data Preprocessing: Handle missing values in the dataset. Encode categorical variables appropriately. Transform the target variable as needed. Ensure data suitability for modeling.</p>
  </li>
  <li>
    <p>Feature Engineering: Creating or refining features that improve model performance.</p>
  </li>
  <li>
    <p>Hyperparameter Tuning: Using Bayesian Optimization to fine-tune the XGBoost Regressor for optimal results.</p>
  </li>
  <li>
    <p>Model Comparison: Compare the linear regression model with the XGBoost Regressor. Determine which model performs better. Assess their accuracy in predicting healthcare costs.</p>
  </li>
</ul>
<br><h2><strong>Data Collection</strong></h2>
<h3><strong>Data Preparation</strong></h3>
<p>We use a dataset with healthcare records to train the XGBoost Regressor. Specifically, features include age, BMI, smoking status, region, and costs. This data represents real-world medical expenses from diverse health profiles. Our goal is to identify features that impact costs. Therefore, we use the XGBoost Regressor. We then use this information to predict future expenses. We do this accurately with the XGBoost Regressor.</p>
<h3><strong>Data Preparation Workflow</strong></h3>
<ul>
  <li>
    <p>Data Cleaning: We start by checking for missing values and outliers in the dataset. This ensures that the data is clean and consistent for modeling.</p>
  </li>
  <li>
    <p>Feature Encoding: We one-hot encode categorical variables like 'sex' and 'region.' This process converts them into numerical values.</p>
  </li>
  <li>
    <p>Target Transformation: Healthcare costs often have a skewed distribution. We apply a Yeo-Johnson transformation. This makes the target variable more normally distributed. As a result, model performance improves.</p>
  </li>
  <li>
    <p>Data Splitting: The dataset is split into training and test sets, typically using a ratio of 80:20. This allows us to train the model on one portion of the data and evaluate it on the remaining portion.</p>
  </li>
</ul>


<h2>Code Explanation</h2>
<h3>Mounting Google Drive</h3>
<p class=""><span style="white-space-collapse: preserve-breaks; font-size: 17px;">You can mount your Google Drive in a </span><a href="https://colab.research.google.com/" style="white-space-collapse: preserve-breaks; background-color: rgb(255, 255, 255); font-size: 17px;">Google Colab notebook</a><span style="white-space-collapse: preserve-breaks; font-size: 17px;"> with this block of code. This lets users easily view files saved in Google Drive within Colab. You can modify and analyze your data or even train models using the files.</span></p>


<h4><strong>Import required packages</strong></h4>
<p>We import essential libraries such as numpy, pandas, and matplotlib. We also include seaborn, plotly, and xgboost. These libraries help with data manipulation, visualization, and building machine learning models.</p>


<h3><strong style="color: inherit; font-family: inherit; font-size: 1.5rem;">Exploratory Data Analysis (EDA)</strong></h3>
<p>EDA stands for "Exploratory Data Analysis." It is a method used to examine data through visualizations. Specifically, EDA involves identifying trends and patterns using statistical and visual techniques.</p>
<p>People use it to figure out trends in data, find outliers, test assumptions, and so on. The main goal of Exploratory Data Analysis (EDA) is to allow individuals to explore and understand the data before developing any theories or hypotheses about it.</p>
<p>When creating a machine learning model, EDA is a crucial step. It helps us understand how variables are distributed and how different variables relate to each other. EDA also identifies which features are crucial for making predictions.</p>
<p>Firstly, let's read the information, which is in the folder called "input" and is named "insurance.csv".</p>
<h4><strong>Load Dataset</strong></h4>


<p class="">Dataset Structure Overview Using <code data-start="44" data-end="57" data-is-only-node="">data.info()</code></p>


<p>We have three numeric features: Age, BMI, and Children. Additionally, we have three categorical features: Sex, Smoker, and Region.</p>
<p><b>NOTE:</b> there are no null values in any of the columns, which means we won't need to impute values in the data preprocessing step. However, This is usually a step that you'll need to consider when building a machine learning model.</p>
<p>The target variable, which we want to predict, is the `charges` column. Now, let's split the dataset into features (X) and the target (y):</p>


<br><h4><strong>Distributions</strong></h4>
<p>Let's examine the distribution of each feature by plotting a histogram for each. Additionally, here are key points to note about the distribution of each feature:</p>
<ul>
  <li>
    <p><strong>Age -</strong> Approximately uniformly distributed.</p>
  </li>
  <li>
    <p><strong>Sex -</strong> Approximately equal volume in each category.</p>
  </li>
  <li>
    <p><strong>Bmi -</strong> Approximately normally distributed.</p>
  </li>
  <li>
    <p><strong>Children -</strong> Right skewed (i.e. higher volume in lower range).</p>
  </li>
  <li>
    <p><strong>Smoker -</strong> Significantly more volume in the no category vs the yes category.</p>
  </li>
  <li>
    <p><strong>Region -</strong> Approximately equal volume in each category.</p>
  </li>
</ul><br>
<p>The distribution is right skewed (i.e. higher volume in the lower range).</p>


<h4><strong>Univariate analysis (with respect to the target)</strong></h4>
<p>The next step is to use binary analysis on the target. In other words, we look at each trait and figure out how it fits with the goal.</p>
<p>How we do this changes based on whether the trait is a number or a set of words. We'll use a scatterplot for numerical features and a boxplot for categorical features.</p><h4><strong>Numeric features</strong></h4>
<h5><strong>Points to note regarding each feature:</strong></h5>
<ul>
  <li>
    <p><strong>Age -</strong> As Age increases, Charges also tend to increase (although there is a large variance in Charges for a given Age).</p>
  </li>
  <li>
    <p><strong>BMI -</strong> There is no clear relationship. However, a group of individuals with BMI &gt; 30 tends to have charges above 30k.</p>
  </li>
  <li>
    <p>This group may become more apparent when we carry out our bivariate analysis later.</p>
  </li>
  <li>
    <p><strong>Children -</strong> No clear relationship (although Charges seem to decrease as Children increase).</p>
  </li>
  <li>
    <p>Since there are only 6 unique values, we will treat this feature as categorical. This approach is useful for univariate analysis.</p>
  </li>
</ul>


<h3><strong style="color: inherit; font-family: inherit; font-size: 1.5rem;">Categorical features</strong></h3>


<h4><strong>Things to keep in mind about each feature:</strong></h4>
<ul>
  <li><b>Sex -</b> No significant differences in Charges between the categories.</li>
  <li><b>Smoker -</b> Charges for Smoker == 'yes' are generally much higher than when Smoker == 'no'.</li>
  <li><b>Region -</b> No significant differences in Charges between the categories.</li>
  <li><b>Children -</b> No significant differences in Charges appear between the categories. Children with 4 or more are skewed towards lower Charges. However, this is likely due to low volumes in those categories. Refer to the distributions section for more details.</li>
</ul>


<h3><strong style="color: inherit; font-family: inherit; font-size: 1.5rem;">Create scatter matrix and Chi squared Test.</strong></h3>


<h4><strong>Chi-Squared Test for Categorical Features</strong></h4>
<p>The Chi-squared test examines if two categorical variables are significantly associated. It does this by comparing observed and expected frequencies in a contingency table. A p-value less than 0.05 indicates a significant association. This suggests that the variables are related rather than independent.</p>


<h4><strong>Numeric categorical feature pairs</strong></h4>
<h5><strong>ANOVA</strong></h5>
<p>Firstly, we will use an ANOVA test for pairings of numerical and category features. ANOVA, or analysis of variance, checks for changes between group means. It then assesses if these changes are statistically significant. Essentially, ANOVA compares the means of two or more independent groups. If the result is significant, it indicates that group means differ.</p><br>
<p>Analysis of variances, or ANOVA, looks at the differences between population means. There are two groups being tested to see if their means are different. To run ANOVA, you need at least one continuous variable and one categorical variable. ANOVA examines differences between means to determine if the differences are significant.</p><br>
<p>It uses ANOVA to see how the variance of groups means compared to the variance of the groups themselves. This process determines if the groups are from the same population or different ones. It helps to identify if the groups can be separated in distinct ways.</p><br>
<p>Despite the fact that it looks at differences, it tries limits. This is the simplest type of ANOVA. This way of comparing groups goes beyond t tests and can be used with more than two groups. The alternative theory suggests that at least one group has a different meaning.</p>Watch full explanation for <a href="https://youtu.be/qV-WoquC4dA?si=2G8gH2XKB_iqWiCh">Introduction to ANOVA</a> here.


<h3 class="" style='font-family: -apple-system, BlinkMacSystemFont, "Segoe UI", Roboto, Helvetica, Arial, sans-serif; color: rgb(41, 41, 41);'><font color="#111827">Input Code</font></h3>


<br><h3><strong style="color: inherit; font-family: inherit; font-size: 1.5rem;">Choosing an ML Model</strong></h3>
<p>For this project, we selected the XGBoost Regressor as the primary model. XGBoost is known for its strong performance with complex datasets. Moreover, it handles non-linear relationships effectively. This method builds decision trees sequentially. Each new tree corrects errors made by the previous one. Consequently, this approach makes XGBoost ideal for predicting healthcare costs. Healthcare data often involves complex interactions.</p><br>
<p>We also implemented a Linear Regression model as a baseline. Linear regression is a simpler model. It helps establish an initial understanding of feature relationships. This includes understanding how these features relate to healthcare costs. However, Its limitations in handling non-linear patterns make XGBoost a better option. XGBoost can manage these patterns more effectively for this project.</p><br>
<h4><strong>Why Linear Regression and XGBoost model?</strong></h4>
<h5><strong>1. Linear Regression Model</strong></h5>
<ul>
  <li>
    <p>Simplicity and Interpretability: Linear Regression assumes a linear relationship between features. For example, it considers age, BMI, and smoking status. This makes the results easy to interpret.</p>
  </li>
  <li>
    <p>Benchmark for Comparison: It sets a baseline for performance. Thus, we can compare it with more advanced models.</p>
  </li>
  <li>
    <p>Computational Efficiency: Linear Regression is fast and lightweight. Therefore, it is suitable for quickly assessing data fit.</p>
  </li>
</ul>
<br><h5><strong>2. XGBoost Regressor</strong></h5>
<ul>
  <li>
    <p>Handling Non-Linear Relationships: XGBoost models complex, non-linear interactions between features. Consequently, it offers more accurate predictions of healthcare costs.</p>
  </li>
  <li>
    <p>Boosting Algorithm for Improved Performance: XGBoost uses gradient boosting. This method corrects the errors of previous models. As a result, it enhances accuracy.</p>
  </li>
  <li>
    <p>Regularization for Overfitting Prevention: It includes built-in regularization techniques (L1 and L2). Hence, it helps prevent overfitting and ensures good generalization.</p>
  </li>
</ul>
<br><p><strong>Feature Importance:</strong> XGBoost highlights which features are most influential in predicting costs. Thus, it provides valuable insights into feature importance.</p><br>
<h4><strong>Linear Regression Model Model Building</strong></h4>
<p>We start by creating a Linear Regression model. This model acts as our baseline. It helps us grasp the basic relationships between features and the target variable. However, Linear Regression may not fully capture the complexities of the dataset. Therefore, we use more advanced models for better accuracy.</p><br>
<h4><strong>Data preprocessing</strong></h4>
<p>Splitting the dataset into training data and test data.</p><br>
<p><img src="https://backend.aionlinecourse.com/uploads/ai_projects/widgets/2024/07/Splitting_dataset.webp" alt="Splitting_dataset"></p><br>
<h4><strong>Encoding (One - Hot Encoding)</strong></h4>
<p>Machine learning algorithms often struggle with categorical data, which must be converted to numerical data. One hot encoding approach addresses this issue by creating a new feature for each label and assigning a value of 1. This method creates a boolean column for each category in each category feature, ensuring that the model interprets the data correctly. However, this method may cause bias, as the model may consider blue to be superior to red.</p><br>
<h4><strong>Transformation of the target</strong></h4>
<p>The target's non-normal distribution may result in residuals with different variance across values, violating assumption 5 of the linear regression model. Power transforms, a family of parametric, monotonic transformations, can make data more Gaussian-like, useful for modeling issues with heteroscedasticity or normality. PowerTransformer supports both the Box-Cox and Yeo-Johnson transforms, so the Yeo-Johnson transformation will be used.</p>


<h4><strong>Linear Regression Model training</strong></h4>
<p>When the model is trained, observations with higher "Charges" receive more weight. Observations with lower "Charges" are given less weight. Therefore, residuals are penalized more for larger "Charges." In contrast, residuals from smaller "Charges" receive less penalty.</p><br>
<p>We will use the sample weight from the target column. Firstly, we will scale it by the lowest number in the "Charges" column, which is 1. As a result, the lowest sample weight will be 1.</p>


<h4><strong>Evaluation The Model</strong></h4>
<p>We can use our model to make predictions on both our training and test sets now that we've trained it. The code checks metrics like MSE, RMSE, MAE, and R^2. These metrics evaluate the performance of the linear regression model by assessing its accuracy on the training data, followed by presenting the results.</p>


<p>This code evaluates the performance of a machine learning model. It tests the model using linear regression on test data. Next, the code calculates metrics such as mean squared error (MSE). Then, it computes the root mean squared error (RMSE). It also computes mean absolute percentage error (MAPE) and R-squared (R&sup2;) score. Finally, the code prints the results.</p>


<p>This code creates a table showing evaluation metrics. It includes MSE, RMSE, MAPE, and R&sup2;. The metrics are displayed for both training and test datasets. Additionally, the code plots predicted values versus actual values. This visualization helps in understanding model performance.</p>


<h4><strong>Check normality of residuals</strong></h4>
<p>A QQ (quantile-quantile) plot helps us check if the residuals are normally distributed. This plot shows the difference between each real quantile and the theoretical quantile. The real quantiles come from the data. The theoretical quantiles are based on a normal distribution. Therefore, if the data were perfectly normally distributed, we would expect a straight line. The data points would align along this line.</p><br><p>We will also use a histogram to make the residuals easier to understand.</p>


<h4><strong>Check homoscedasticity</strong></h4><p>We can check for homoscedasticity using a scatter plot. In this plot, the target variable is on the x-axis, while the residuals are on the y-axis. Ideally, we expect the data points to be evenly distributed as the target value increases.</p>


<h3><strong style="color: inherit; font-family: inherit; font-size: 1.5rem;">XGBoost Regressor Model Building</strong></h3>
<p>We begin by constructing a linear regression model to serve as a baseline. This model helps us understand basic relationships between features and the target variable. However, linear regression may not capture dataset complexities. Therefore, we use the XGBoost Regressor for improved accuracy.</p><br>
<h4><strong>Improve on the baseline linear model</strong></h4>
<p>Now, let's try to improve our linear regression model by training a non-linear model. Specifically, non-linear means the model can learn complex, non-linear relationships from the data. Before moving on to XGBoost Regressor let's understand Decision Trees.</p><br>
<h4><strong>Decision Tree</strong></h4>
<p>There are supervised machine learning methods known as decision trees, which can solve both regression and classification problems. Also called CART, or Classification and Regression Trees, decision trees are represented by a tree-like flowchart. It starts with a root node at the top, followed by leaf nodes at the bottom. Consequently, the tree shows predictions based on feature-based splits, making it a clear and visual tool for decision-making.</p><br>
<h4><strong>Decision Tree and Overfitting</strong></h4>
<p>Decision trees are complex algorithms that divide features into similar parts based on a cost function. Numerous splits occur as the algorithm is designed to fit all samples in the training dataset, potentially leading to overfitting. As the tree grows, it learns each feature value for every observation. This may lead to errors when testing new data. Decision trees are especially prone to overfitting. The cost function is used to find the best split places and conditions.</p><br>
<h4><strong>Bagging and Boosting</strong></h4>
<p>Ensemble learning methods include bagging and boosting. That lowers the estimator's range. Using the combined power of various learners to get a series of average results.</p><br>
<h4><strong>Boosting</strong></h4>
<p>This can cause overfitting. As the tree grows, it learns each feature value for every observation. This may lead to errors when testing new data. Decision trees are especially prone to overfitting. Each model fixes the mistakes of the ones that came before it. This process continues until we can accurately forecast the data. Alternatively, it stops when we reach the maximum number of models.</p><br>
<p>Boosting, unlike a specific method, can improve the performance of multiple weak models. It gives more weight to misclassified data. This helps the program focus on tough cases. As a result, the model's accuracy improves.</p><br>
<p>Boosting is not the same as bagging, which works best for models with a lot of variation and little bias. Boosting works best for models with low variance and high bias. However, because it aims to minimize mistakes, it can lead to overfitting.</p><br>
<h4><strong>Gradient Boosting</strong></h4>
<p>Gradient boosting creates models sequentially. First, each model corrects the mistakes of the previous one. The additive model, the loss function, and a weak learner are the three main parts. Additionally, these components work together to create the system.</p><br>
<p>This method views Boosting as numerical optimization using Gradient Descent. We use the Gradient Boosting Classifier for classification tasks. On the other hand, for regression tasks, we use the Gradient Boosting Regressor. What differentiates them is the "loss function." Specifically, we use Mean Squared Error (MSE) for regression and log-likelihood for classification. Ultimately, the goal is to lower the loss function by adding weak learners.</p><br>
<h4><strong>Introduction to a non-linear model - XGBoost</strong></h4>
<p>XGBoost stands for eXtreme Gradient Boosting. It is a powerful decision tree-based method. Often, XGBoost is used in machine learning competitions. For instance, in regression, this is how XGBoost works:</p>
<ul>
  <li>
    <p>Making an initial guess: Begin by making an initial guess, like 0.5.</p>
  </li>
  <li>
    <p>Find the difference between the predicted values and the real values.</p>
  </li>
</ul>
<br><p><strong>Fit Regression Tree: To guess the residuals, make a decision tree.</strong></p>
<ul>
  <li>
    <p>Figure out how alike each leaf is.</p>
  </li>
  <li>
    <p>To get the most gain, try splitting nodes.</p>
  </li>
  <li>
    <p>Pruning Tree: Use a threshold parameter to get rid of breaks that have low gain.</p>
  </li>
</ul>
<ul>
  <li>
    <p>Combine the first forecast with the tree's prediction. This combination is based on how quickly the tree learns.</p>
  </li>
  <li>
    <p>Repeat: Repeat steps 1-5 until the residuals are as small as possible. Alternatively, stop when you reach the maximum number of trees.</p>
  </li>
</ul>
<p>Some important XGBoost settings are `n_estimators`, `gamma`, `reg_lambda`, `learning_rate`, and `min_child_weight`. First, these settings help create a highly accurate model. Next, the model improves predictions repeatedly. Each iteration reduces mistakes further.</p><br>
<h4><strong>Data preprocessing</strong></h4>
<p>We need to create a new training set and test set. The previous sets have been altered. Therefore, we must generate fresh data to ensure accuracy.</p>
<p>Note: We use the same "random_seed" number for both sets. Thus, this ensures consistency with the baseline linear model's training and test sets.</p><br>
<h4><strong>Train/test split</strong></h4>


<br><h4><strong>Model evaluation</strong></h4>
<p>Firstly, let&rsquo;s examine how each set of parameters performed across each fold. Each record in the dataset represents a set of parameters that were tested. We then use rank_test_score to ensure that the best set of parameters appears at the top.</p>


<p class="">Let's use the model we trained with our best parameters to make guesses on both our training and test sets:</p>


<h4><strong>Giving the data to stakeholders who aren't technical</strong></h4>
<p>A lot of the time, data scientists have to tell people who aren't pros in the field how well a model works. This means that metrics like Root mean square error (RMSE) aren't very useful due to their complexity.</p><br>
<p>Instead, let's show the percentage of times our model's predictions are close to the real "charges" number. As an example, the portion of our model's test set predictions that are within $10,000 of the real "charges" number is:</p>


<p>We can also show the percentage of predictions close to actual charges. We calculate the distance between the prediction and real values to show the percentage of predictions close to actual charges. This helps us understand the accuracy of our model better.</p>
<p><strong>For example,</strong> We can measure the percentage of predictions within 30% of the actual charges. This gives us an idea of how accurate our model is:</p>


<h2><strong>Project Conclusion</strong></h2>
<p>The Insurance Pricing Forecast Using XGBoost Regressor project demonstrates machine learning's capabilities. Moreover, it shows how to predict healthcare costs using the XGBoost Regressor. The XGBoost model outperformed the linear regression baseline. Specifically, it offered more accurate predictions and handled non-linear relationships effectively. Consequently, insurance companies can use this XGBoost Regressor to set premiums more reliably. This approach helps reduce operational costs and boost profitability.</p>
<br><h2><strong>Challenges and Troubleshooting</strong></h2>
<h3><strong>Handling Skewed Data</strong></h3>
<ul>
  <li>
    <p>The dataset had a skewed distribution of healthcare costs, which affected predictions.</p>
  </li>
  <li>
    <p>We applied the Yeo-Johnson transformation to address this skewness.</p>
  </li>
  <li>
    <p>The transformation normalized the healthcare cost data.</p>
  </li>
  <li>
    <p>Normalizing the data improved its suitability for machine learning models.</p>
  </li>
  <li>
    <p>This resulted in more accurate predictions from the models.</p>
  </li>
</ul>
<br><h3><strong>XGBoost Regressor Hyperparameter Tuning</strong></h3>
<ul>
  <li>
    <p>Tuning the hyperparameters of the XGBoost Regressor was essential for success.</p>
  </li>
  <li>
    <p>We utilized Bayesian Optimization to optimize the hyperparameters effectively.</p>
  </li>
  <li>
    <p>It explores a wide range of hyperparameter values for better performance.</p>
  </li>
  <li>
    <p>The optimization process significantly improved model accuracy.</p>
  </li>
  <li>
    <p>Bayesian Optimization also helped in preventing overfitting, ensuring reliable results.</p>
  </li>
</ul>
<br><h3><strong>XGBoost Regressor Model Evaluation</strong></h3>
<ul>
  <li>
    <p>Selecting the right evaluation metrics was crucial for assessing model performance.</p>
  </li>
  <li>
    <p>We used metrics such as RMSE, MAPE, and R-squared for evaluation.</p>
  </li>
  <li>
    <p>These metrics offered valuable insights into how the model performed.</p>
  </li>
  <li>
    <p>These metrics helped us understand the accuracy of the model's predictions.</p>
  </li>
  <li>
    <p>Ultimately, these metrics demonstrated how effectively the model predicted healthcare costs.</p>
  </li>
</ul>
<br><h2><strong>FAQ</strong></h2>
<ol>
  <li>
    <p><strong>What is the purpose of this project?</strong></p>
    <ul>
      <li>
        <p><strong>Answer:</strong> The goal is to build a machine learning model. This model will predict healthcare costs for insurance companies. It will help them set premiums more accurately.</p>
      </li>
    </ul>
  </li>
  <li>
    <p><strong>Why did we choose XGBoost for this project?</strong></p>
    <ul>
      <li>
        <p><strong>Answer:</strong> XGBoost handles complex datasets with non-linear relationships. This makes it ideal for predicting healthcare costs.</p>
      </li>
    </ul>
  </li>
  <li>
    <p><strong>What are the key features used in this model?</strong></p>
    <ul>
      <li>
        <p><strong>Answer:</strong> Key features include age, BMI, smoking status, and region. Each significantly impacts healthcare expenses.</p>
      </li>
    </ul>
  </li>
  <li>
    <p><strong>How do you evaluate model performance?</strong></p>
    <ul>
      <li>
        <p><strong>Answer:</strong> We use metrics like RMSE, MAPE, and R-squared to evaluate model accuracy and effectiveness.</p>
      </li>
    </ul>
  </li>
  <li>
    <p><strong>What were the main challenges?</strong></p>
    <ul>
      <li>
        <p><strong>Answer:</strong> The main challenges included handling skewed data, tuning the XGBoost hyperparameters, and selecting the right evaluation metrics.</p>
      </li>
    </ul>
  </li>
</ol>
