Result
Assumption Checks and Correlation Analysis
Before predictive modeling, correlations among numeric predictors were assessed. A correlation matrix was created for tweet length, sentiment confidence, and temporal variables (hour, day of week). None of the correlations exceeded r = 0.70, suggesting that multicollinearity was not a major concern.
Table 4.
Correlation Matrix of Numeric Predictors.
Table 4.
Correlation Matrix of Numeric Predictors.
| Variable |
Tweet Length |
Sentiment Confidence |
Hour of Day |
Day of Week |
| Tweet Length |
1.00 |
0.12 |
0.05 |
0.01 |
| Sentiment Confidence |
0.12 |
1.00 |
0.03 |
-0.04 |
| Hour of Day |
0.05 |
0.03 |
1.00 |
0.14 |
| Day of Week |
0.01 |
-0.04 |
0.14 |
1.00 |
Sentiment Distribution
The data has negative sentiment classifications which can distribution evenly across the three categories.
Figure 1. Distribution of Sentiment Classifications
[Bar chart placeholder: Negative = 63%, Neutral = 21%, Positive = 16%]
Confusion Matrix
We conducted an additional performance evaluation by constructing a confusion matrix specifically for the XGBoost classifier.
Figure 2. XGBoost Model Confusion Matrix Analysis
The model demonstrated varying classification accuracy across sentiment categories:
Negative sentiment detection achieved 83% accuracy
Neutral classification reached 78% correct identification
Positive sentiment recognition attained 76% precision
The analysis showed the errors during the classification which are classified to neutral and positive categories. The model cannot distinguish between the positive expressions and neutral statements.
Error Analysis
Analysis is performed on the tweets data which was not categorized properly initially.
The patterns were also not available in the tweets data initially and it has many repeated errors initially.
Sarcasm and Implicit Negativity: The sarcastic comments or important remarks as positive sentiment, did not found the negative tone.
Mixed Sentiment Expressions: Tweets used both the positive tweets and negative tweets and their important issues which are classified by default to neutral the categorization.
Linguistic Variations: Messages has informal language like the abbreviated words, usage of the emoji and spelling which is not proper. It caused more problem for classifying accurately. This finding has provided the importance of text preprocessing techniques which can manage the different patterns. Different pattern is very common in social media communication.
These findings have showed that there is a need of sentiment classification systems which can find the pattern s in the social media.
Summary of Results
This study analyzed the data form the social media from Twitter. It is used for classifying the customers based on the sentiment in the U.S. airlines. Using the machine learning techniques, the solution is found for many research questions like textual and categorical features which can find the sentiment level of the customers.
Exploratory analysis showed that the dataset has no proper structure with around 63% of tweets has negative feedback and it showed that the customers uses the Twitter to communicate the complaints. Sentiment changes across the airlines in the US Airways. It has the highest proportion of negative tweets and Virgin America has more positive engagement.
Model evaluation showed that XGBoost has the highest performance with accuracy as 0.82 and F1-score as 0.79. The frequently of misclassification have happened between the tweets which are neutral and tweets which are positive. It has many issues to distinguish the positive comment and negative comments. The past studies are used in the result to know the efficiency level while analysing the sentiment.
Limitations
One issues of this study is the scope of the dataset. The data ahs airline-related tweets from 2015. Language uses social media which is spreading quick and using the old data the models are trained. A solution is sued for the newer data for enhancing the accuracy level.
No proper balance for the class is it’s another limitation. The two-thirds of the dataset are negative. The models are based on the predicting negative sentiment. The future studies can solve this by using the resampling methods by gathering a dataset across the sentiments.
Future Directions
Future research needs to use the real-time sentiment analysis in many social media platforms like the facebook, Instagram or TikTok which provides the customer perceptions. The deep learning techniques like the BERT or GPT-based transformers are used. It is sued for collecting the semantic meaning which decreases the misclassifications level. The transformer models are used to denote the important advancement.
Importance and Implications
This study used the business value for converting the data which has no proper structured of the social media text into useful insights. The real-time sentiment tracking is used in airline which informs the customer service techniques and helps to find the problems like delays or enhancement in the reputation of brand.
The methods can also be used in other industries like retail, banking and technology.
The sentiment analytics are used in the companies which can solve the negative comment provided by the customers and enhances the trust level of the customers.