Airbnb Price Prediction Using Machine Learning and Sentiment Analysis

TL;DR

This paper develops a machine learning-based model incorporating sentiment analysis to predict Airbnb rental prices, aiding owners and customers in price evaluation with minimal property information.

Contribution

It introduces an integrated approach combining machine learning, deep learning, and NLP techniques for Airbnb price prediction, utilizing diverse features and models.

Findings

Model achieves accurate price predictions across various algorithms.

Sentiment analysis of reviews improves prediction accuracy.

The approach supports better pricing decisions for owners and customers.

Abstract

Pricing a rental property on Airbnb is a challenging task for the owner as it determines the number of customers for the place. On the other hand, customers have to evaluate an offered price with minimal knowledge of an optimal value for the property. This paper aims to develop a reliable price prediction model using machine learning, deep learning, and natural language processing techniques to aid both the property owners and the customers with price evaluation given minimal available information about the property. Features of the rentals, owner characteristics, and the customer reviews will comprise the predictors, and a range of methods from linear regression to tree-based models, support-vector regression (SVR), K-means Clustering (KMC), and neural networks (NNs) will be used for creating the prediction model.

Tables

Table 1. Table 1: Performance metrics of the trained models

Model Name		train split			test split
	MAE	MSE	$R^2$ Score	MAE	MSE	$R^2$ Score
Linear Reg. (Baseline)	0.2744	0.1480	0.690	96895.82	2.4E13	-5.1E13
Ridge Reg.	0.2813	0.15461	0.6765	0.2936	0.1613	0.6601
Gradient Boost	0.2492	0.1376	0.7121	0.3282	0.1963	0.5864
K-means + Ridge Reg.	0.2717	0.1438	0.6992	0.2850	0.1543	0.6748
SVR	0.2132	0.1067	0.7768	0.2761	0.1471	0.6901
Neural Net	0.2602	0.1316	0.7246	0.2881	0.1570	0.6692

Equations

$$\underset{w,b,\xi ,{\xi }^{\ast }}{\min }\frac{1}{2}||w|{|}^2+C\sum _{i=1}^m{\xi }_i+C\sum _{i=1}^m{\xi }_i^{\ast },\text{subject to}$$

$$w^T\varphi (x^{(i)})+b-y^{(i)}\le ϵ+{\xi }_i,$$

$$y^{(i)}-w^T\varphi (x^{(i)})-b\le ϵ+{\xi }_i^{\ast },$$

$${\xi }_i,{\xi }_i^{\ast }\ge 0,i=1,...,m$$

$$K(x,z)=\exp \left(\frac{||x-z|{|}^2}{2{\sigma }^2}\right)$$

$$\underset{j,t}{\max }L(R_p)-(L(R_1)-L(R_2))$$

Full text

Airbnb Price Prediction Using Machine Learning and Sentiment Analysis

Pouya Rezazadeh Kalehbasti

Stanford University

pouyar@stanford.edu

&Liubov Nikolenko

Stanford University

liubov@stanford.edu

&Hoormazd Rezaei

Stanford University

hoormazd@stanford.edu

1 Introduction

Pricing a rental property on Airbnb is a challenging task for the owner as it determines the number of customers for the place. On the other hand, customers have to evaluate an offered price with minimal knowledge of an optimal value for the property. This paper aims to develop a reliable price prediction model using machine learning, deep learning, and natural language processing techniques to aid both the property owners and the customers with price evaluation given minimal available information about the property. Features of the rentals, owner characteristics, and the customer reviews will comprise the predictors, and a range of methods from linear regression to tree-based models, support-vector regression (SVR), K-means Clustering (KMC), and neural networks (NNs) will be used for creating the prediction model.

2 Related Work

Parts of the existing literature on property pricing focus on non-shared property purchase or rental price predictions. Previously, Yu and Wu [1] tried to implement a real estate price prediction using feature importance analysis along with linear regression, SVR, and Random Forest regression. They also attempted to classify the prices into 7 classes using Naive Bayes, Logistic Regression, SVC and Random Forest. They declared a best RMSE of 0.53 for their SVR model and a classification accuracy of 69% for their SVC model with PCA. In another paper, Ma et al. [2] have applied Linear Regression, Regression Tree, Random Forest Regression and Gradient Boosting Regression Trees to analyzing warehouse rental prices in Beijing. They concluded that the tree regression model was the best-performing model with an RMSE of 1.05 CNY/$m^{2}$-day

Another class of studies, which are more pertinent to this work, inspect the hotels and sharing economy rental prices. In a recent work, Wang and Nicolau [3] have studied price determinants of sharing economy by analyzing Airbnb listings using ordinary least squares and quantile regression analysis. In a similar study, Masiero et al. [4] use quantile regression model to analyze the relation between travel traits and holiday homes as well as hotel prices. In a simpler work, Yang et al. [5] applied linear regression to study the relationship between market accessibility and hotel prices in Caribbean. They also included the user ratings and hotel classes as contributing factors in their study. Li et al. [6] also studied a clustering method called Multi-Scale Affinity Propagation and applied Linear Regression to the obtained clusters in an effort to create a price prediction model for Airbnb in different cities. They took the distance of the property to the city landmarks as the clustering feature.

This research has tried to improve and add to the experimented methods from the literature by focusing on a variety of feature selection techniques, implementing Neural Networks, and leveraging the customer reviews through sentiment analysis. The last two contributions are novel undertakings in rental price prediction as they were not observed in the existing body of literature.

3 Dataset

The public Airbnb dataset for New York City [7] was used as the main data source for this study. The dataset included 50,221 entries, each with 96 features. Figure 1 shows the geographic distribution of the listing prices in this dataset.

For the initial prepossessing, the authors inspected each feature of the dataset to (i) remove features with frequent and irreparable missing fields or set the missing values to zero where appropriate, (ii) convert some features into floats (e.g. by removing the dollar sign in prices), (iii) change boolean features to binaries, (iv) remove irrelevant or uninformative features, e.g. host picture url, constant-valued fields or duplicate features, and (v) convert the 10 categorical features in the final set, e.g. ‘neighborhood name’ and ‘cancellation policy,’ into "one-hot vectors." In addition, the features were normalized and the labels were converted into logarithm of the prices to mitigate the impact of the outliers in the dataset. The data was split into three sets; namely, train set (comprising 90% of the original data), validation set, and test set (both comprising 5% of original data). Since the dataset was relatively large, 10% of the data was deemed sufficient for the accumulated testing and validation sets. The following explains the sentiment analysis conducted on the reviews and the steps taken for selecting the most important features among the available set of features.

3.1 Sentiment Analysis on the Reviews

Given the importance of customer reviews on the pricing of an Airbnb listing, and in order to increase the accuracy of the predictive model, the reviews for each listing were analyzed using TextBlob [8] sentiment analysis library and the results were added to the set of features. This method assigns a score between -1 (very negative sentiment) and 1 (very positive sentiment) to each analyzed text. For every listed property, each reviews was analyzed using this method and the scores were averaged across all the reviews associated with that listing. The final scores for each listing was included as a new feature in the model.

3.2 Feature Selection

After data preprocessing, the feature vector contained 764 elements. Feeding this excessive set of features to the models resulted in a high variance of error. Consequently, several feature selection techniques were used to find the features with the most predictive values to both reduce the model variances and reduce the computation time. Based on prior experience of the authors with housing price estimation, the first tried method was manual selection of features to create a baseline for evaluating the other feature selection processes.

The second selection method was tuning the coefficient of linear regression model with Lasso Regularization trained on the train split. Based on this analysis, the model with the best performance over validation split was selected. The resulting set consisted of 78 features with non-zero values, i.e. 90% less than the number of original features.

Finally, lowest p-values of regular linear regression model trained on train split were used to choose the third set of features. An upper limit of 100 features was imposed on the selection procedure. The final set was comprised of 22 features for which linear regression model performed the best on the validation split. As an example to demonstrate the results of the feature selection techniques, Appendix A lists the set of features resulting from this p-value analysis.

The performance of manually selected features as well as p-value and Lasso feature selection schemes were compared using the $R^{2}$ score of the linear regression models trained on the validation set. All models outperformed the baseline model, which used the whole feature set, and the second method, Lasso regularization, yielded the highest $R^{2}$ score. Figure 2 shows the best $R^{2}$ scores obtained using the set of features identified with each feature selection method.

4 Methods

Linear Regression using the entire set of features as model inputs was taken as the baseline model for evaluating the performance of the other methods. After selecting a set of features using Lasso feature selection, several machine learning models were considered in order to find the optimal one. All of the models except neural networks were implemented using Scikit-learn library [9]. The neural network model was implemented with the help of Keras library [10]. The implemented models are introduced in what follows.

4.1 Ridge Regression

Linear Regression with $L_{2}$ regularization adds a penalizing term to the squared error cost function in order to help the algorithm converge for linearly separable data and reduce overfitting. Therefore, Ridge Regression minimizes $J(\theta)=||y-X\theta||^{2}_{2}+\alpha||\theta||_{2}^{2}$ with respect to $\theta$, where $X$ is a design matrix and $\alpha$ is a hyperparameter. Since the baseline models were observed to have high variance, Ridge Regression seemed to be an appropriate choice to solve the issue.

4.2 K-means Clustering with Ridge Regression

In order to capture the non-linearity of the data, the training examples were split into different clusters using k-means clustering on the features and the Ridge Regression was run on each of the individual clusters. The data clusters were identified using the following algorithm:

4.3 Support Vector Regression

In order to model the non-linear relationship between the covariates, the authors employed support vector regression with RBF kernel to identify a linear boundary in a high-dimensional feature space. Using the implementation based on Chang and Lin [11], the algorithm provides a solution for the following optimization problem:

[TABLE]

where $C>0,\epsilon>0$ are given parameters. This problem can be converted into a dual problem that does not involve $\phi(x)$, but involves $K(x,z)=\phi(x)\phi(z)$ instead. Since we are using RBF kernel, $K(x,z)$ was taken as

[TABLE]

4.4 Neural Network

Neural network was used to build a model that combined the input features into high level predictors. The architecture of the optimized network had 3 fully-connected layers: 20 neurons in the first hidden layer with relu activation function, 5 neurons in the second hidden layer with relu activation function, and 1 output neuron with a linear activation function.

4.5 Gradient Boosting Tree Ensemble

Since the relationship between the feature vector and price is non-linear, regression tree seemed like a proper model for this problem. Regression trees split the data points into regions according to the following formula

[TABLE]

where $j$ is the feature the dataset is split on, $t$ is the threshold of the split, $R_{p}$ is the parent region and $R_{1}$ and $R_{2}$ are the child regions. Squared error is used as the loss function.

Since standalone regression trees have low predictive accuracies individually, gradient boost tree ensemble was used to increase the models’ performance. The idea behind a gradient boost is to improve on a previous iteration of the model by correcting its predictions using another model based on the negative gradient of the loss. The algorithm for the gradient boosting is the following [12]:

5 Experiments and Discussion

Mean absolute error (MAE), mean squared error (MSE) and $R^{2}$ score were used to evaluate the trained models. Training (39,980 examples) and validation (4,998 examples) splits were used to choose the best-performing models within each category. The test set, containing 4,998 examples, was used to provide an unbiased estimate of error, with the final models trained on both train and validation splits. Table 1 contains the performance metrics for the final models111Optimized models can be found at github.com/PouyaREZ/AirBnbPricePrediction.git; namely, linear regression, Ridge regression, Gradient Boosting, K-Means Clustering with Ridge Regression, SVR, and Neural Network.

The outlined models had relatively similar $R^{2}$ scores which implies that Lasso feature importance analysis had made the most impact on improving the performance of the models by reducing the variance. Even after the feature selection, the resulting input vector was relatively large leaving room for model overfitting. This explains why Gradient Boost - a tree-based model prone to high variance - performed worse than the rest of the models despite it not performing the worst on the train set.

Despite expanding the number of features in the feature vector, SVR with RBF kernel turned out to be the best performing model with the least MAE and MSE and the highest $R^{2}$ score on both train and test sets (figure 3). RBF feature mapping was able to better model the prices of the apartments which have a non-linear relationship with the apartment features. Since regularization is taken into account in the SVR optimization problem, parameter tuning ensured that the model was not overfitting.

Ridge regression, neural network, K-means + Ridge regression models had similar $R^{2}$ scores even though the last two models are more complex than Ridge regression. The architecture complexity of neural network was limited by the insufficient number of training examples for having too many unknown weights. K-means clustering model faced a similar issue: since the frequency of some prices was greatly exceeding the frequency of others, some clusters received too few training examples and drove down the overall model performance.

6 Conclusions and Future Work

This paper attempts to come up with the best-performing model for predicting the Airbnb prices based on a limited set of features including property specifications, owner information, and customer reviews on the listings. Machine learning techniques including linear regression, tree-based models, SVR, and neural networks along with feature importance analyses are employed to achieve the best results in terms of Mean Squared Error, Mean Absolute Error, and $R^{2}$ score. The initial experimentation with the baseline model proved that the abundance of features leads to high variance and weak performance of the model on the validation set compared to the train set. Lasso-based feature importance analysis reduced the variance and using advanced models such as SVR and neural networks resulted in higher $R^{2}$ score for both the validation and test sets. Among the models tested, Support Vector Regression (SVR) performed the best and produced an $R^{2}$ score of 69% and a MSE of 0.147 (defined on ln(price)) on the test set. This level of accuracy is a promising outcome given the heterogeneity of the dataset and the involved hidden factors and interactive terms, including the personal characteristics of the owners, which were impossible to consider.

The future works on this study can include (i) studying other feature selection schemes such as Random Forest feature importance, (ii) further experimentation with neural net architectures, and (iii) getting more training examples from other hospitality services such as VRBO to boost the performance of K-means clustering with Ridge Regression model in particular.

Appendix A Appendix A

List of features selected using p-value importance method (the last 6 feature names are those of one-hot vectors):

‘longitude’, ‘accommodates’, ‘bathrooms’, ‘bedrooms’, ‘beds’, ‘security_deposit’, ‘cleaning_fee’, ‘guests_included’, ‘Cable_TV’, ‘Dryer’, ‘Washer’, ‘Family/kid_friendly’, ‘Gym’, ‘Elevator’, ‘Entire home/apt’, ‘Private room’, ‘Brooklyn’, ‘Manhattan’, ‘Brooklyn.1’, ‘New York’, ‘Chelsea’, ‘Midtown’