If you\u2019ve ever purchased a property, sold a property, or even browsed available properties online, chances are high that you\u2019ve run across an automated valuation model, or AVM. AVMs are a common feature in real estate, including models like the Zillow Zestimate, CoreLogic, and the Xome \u00ae Value Model. <\/p>\n\n\n\n
AVMs can be great tools to help you estimate a property\u2019s value, but there are a few important things you need to understand to make sure you\u2019re getting the full benefit of an AVM. <\/p>\n\n\n\n
An automated valuation model<\/strong> (AVM)<\/strong> is a model that uses mathematical or statistical methods along with a series of data points to estimate the value of a property. According to the International Association of Assessment Officers, \u201cthe purpose of an AVM is to efficiently provide an accurate, uniform, equitable estimate of fair market value.\u201d <\/p>\n\n\n\n So, in layman\u2019s terms, an AVM gives an educated, data-driven guess of how much a property is worth on the current market.<\/strong> <\/p>\n\n\n\n Competing AVMs may offer different information, depending on the data source(s) and the particular algorithm they use to work with that data. Each AVM vendor will have their own unique approach and may even use different models and rules for different property types to gain higher accuracy and coverage in their valuations. <\/p>\n\n\n\n AVMs are typically used as a convenient starting point to determine the value of a property. They make it easier for both consumers and lenders to get a general idea about property value because they are often faster and more affordable than traditional property appraisals. <\/p>\n\n\n\n Formal appraisals are still a necessary step in most lending situations, but they can be a powerful tool in the early stages of a property purchase. Financial institutions also use AVMs when doing things like making loan decisions, sometimes in combination with traditional appraisals to gauge the accuracy of the AVM results. <\/p>\n\n\n\n Most automated valuation models contain five elements that help them come up with a valuation on a property: <\/p>\n\n\n\n AVMs do not usually include subjective data such as curb appeal in their models.<\/p>\n\n\n\n Automated valuation models do have a margin of error given that they are statistical methods \u2014 they are only as accurate as the data behind them. A natural question when it comes to AVMs is how trustworthy and accurate they might be. How are you supposed to know which one might be more correct? <\/p>\n\n\n\n That\u2019s where confidence scores<\/strong> come in. Confidence scores help users gauge the accuracy and precision of an AVM estimate based on how similar it is to estimates from other AVMs. <\/p>\n\n\n\n Confidence scores are often derived from a metric called the Forecast Standard Deviation<\/strong> (FSD)<\/strong>, which measures the statistical probability of an AVM\u2019s valuation falling within the range of the property\u2019s actual market value. A lower FSD metric means that the AVM estimate is more accurate, whereas a higher FSD would indicate that the metric is less accurate. <\/p>\n\n\n\n For example, if an AVM estimates the value of a target property to be $150,000 with an FSD of 10%, that means there is a 68% statistical <\/strong>certainty <\/strong>that the AVM will fall within 10% of the actual sale price. <\/p>\n\n\n\n (Why 68%? Because 68% represents one standard deviation in a normal statistical distribution according to the empirical rule<\/a>.) <\/p>\n\n\n\n That means in this example, there is a 68% chance the actual value of the property would be somewhere between $135,000 to $165,000. <\/strong> <\/p>\n\n\n\n The confidence score is then found by subtracting the FSD percentage from 100. So, in this example, the score would calculate like this: <\/p>\n\n\n\n 100% – FSD 10% = 90 Confidence Score<\/strong> <\/p>\n\n\n\n Confidence scores can be a helpful way of evaluating the accuracy of an AVM. But there is one important thing to note \u2014 the calculation of FSD and Confidence Scores can vary across the industry. <\/strong> <\/p>\n\n\n\n A confidence score of 90 for one AVM might not been the same thing as a confidence score of 85 for another AVM, depending on how they are calculated and what factors they might be based on. <\/p>\n\n\n\n Given that confidence scores can vary, how do you know that the model you\u2019re working with is a good one? There are five factors you can look to, based on the historical performance of that AVM, that can help you determine if the model you are using is the best one for your needs: <\/p>\n\n\n\n When a property is sold, the transactional data can be used to help attain the percentage<\/strong> sales error<\/strong>. The lower the sales error of the property, the better the accuracy of the model. The sales error is calculated like this: <\/p>\n\n\n\n (AVM Valuation \u2013 Selling Price)\/(Selling Price) * 100<\/strong> <\/p>\n\n\n\n So, if the AVM valuation was $150,000 like in our previous example, and the selling price was $155,000, then this would be the percentage sales error: <\/p>\n\n\n\n ($150,000-155,000)\/($155,000) * 100 = -3.2%<\/strong> <\/p>\n\n\n\n A positive percentage sales error means that the AVM overvalued<\/strong> the property. A negative percentage sales error like in our example means that the AVM undervalued<\/strong> the property. <\/p>\n\n\n\n Sometimes, accuracy and precision are used interchangeably across the industry. Precision<\/strong> typically refers to how consistent the set of valuations is. <\/p>\n\n\n\n Two precision metrics that can be utilized are the Median Absolute Percentage Sales Error<\/strong> (MdAPE) and Mean Absolute Percentage Sales Error (MAPE)<\/strong>. These are two statistical measures that predict the accuracy of a forecasting method. MdAPE gives the middle data point of sales error when ordered from least to greatest and MAPE gives the average of all sale error data points. <\/p>\n\n\n\n Usually, strong AVMs would have lower MAPEs of 10% or below, whereas MAPEs between 10 to 15% might be considered good for certain scenarios. Another metric used for gauging the precision is the Forecast Standard Deviation (FSD)<\/strong>. <\/p>\n\n\n\n Hit rate<\/strong> is a metric that is used to determine the percentage of properties that were able to be estimated. For example, a 98% hit rate might mean that 98 out of 100 properties have an estimate. <\/p>\n\n\n\n Sometimes, different vendors might classify the hit rate in different ways. For example, vendors might classify an AVM valuation as a valid hit only if it is above a certain threshold of confidence score or below a certain threshold of FSD. <\/p>\n\n\n\n It can be difficult to attain<\/strong> higher coverage and higher accuracy\/precision at the same time<\/strong>. The larger the set of data looked at in the hit rate, the more possibility there is for the margin of error to increase.\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0\u00a0<\/p>\n\n\n\n Also, since trends can differ across geographical regions, states, counties \u2014 even down to the neighborhood market level \u2014 AVMs might estimate most of the properties with a reasonably good accuracy and precision measure but might fall short of some properties that did not fit the trends observed from the models. <\/p>\n\n\n\n If these properties are excluded from the estimation, the hit rate decreases and the accuracy improves, but if these properties are included in the pool of estimation, then the hit rate increases but the accuracy decreases. <\/p>\n\n\n\n For example, an AVM\u2019s performance might decrease in rural areas where properties are scattered across the county, compared to suburbs where there is a lot more sale activity. <\/p>\n\n\n\n One of the most important elements of a good AVM is the underlying data it uses. The machine learning or mathematical\/statistical models are entirely dependent upon the quality and accessibility of the data. <\/p>\n\n\n\n Because of that, it is important to have good data sources for things like property characteristics and features (such as bathrooms, bedrooms, fireplaces, etc.), tax assessment records (like land value), neighborhood data (school scores, walkability), price trends, and market trends. <\/p>\n\n\n\n This is why many AVM providers focus on improving the quality and reliability of their data to improve the results of their valuations. <\/p>\n\n\n\n Every AVM vendor might have a different set of mathematical and statistical methods [they use in the form] of machine learning models. It is rare to see an AVM provider use only one model to determine a property\u2019s estimated real estate market value. <\/p>\n\n\n\n The most common trend observed is that a variety of models are used to determine the value of a property. Some vendors might use a suite of neural network models<\/a>, which mimic the brain\u2019s behavior. Other vendors might use a suite of linear regression models<\/a>, which statistically predict the relationship between two variables, to estimate the price of the property. <\/p>\n\n\n\n An important element of a good AVM isn\u2019t just the type of model used, but also whether the most appropriate models are deployed for different scenarios across various property types, geographical regions, and more. <\/p>\n\n\n\n Automated valuation models are not an exact science, given that they are all based on slightly different models, data sources, property information, and algorithms to calculate property valuations. But even so, AVMs can be particularly useful for investors when it comes to time savings, more informed decision making, and augmenting the traditional appraisal approach. <\/p>\n\n\n\n Want to try out an automated valuation model today? Visit Xome.com and search our properties for auction<\/a> and for sale<\/a>. <\/p>\n","protected":false},"excerpt":{"rendered":" Need a tool to help you estimate the value of a property? A good AVM can help you ballpark what a home is worth. <\/p>\n","protected":false},"author":2,"featured_media":1102,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[25,107],"tags":[109,108,110,111,97,94,118],"class_list":["post-1100","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-real-estate-insights","category-real-estate-tech","tag-automated-valuation-model","tag-avm","tag-home-value","tag-property-value","tag-real-estate-investment","tag-real-estate-market","tag-technology"],"yoast_head":"\nWhy are AVMs used? <\/h2>\n\n\n\n
How do AVMs work? <\/h2>\n\n\n\n
\n
What are AVM confidence scores? <\/h2>\n\n\n\n
What are the elements of a reliable automated valuation model? <\/h2>\n\n\n\n
1. Higher accuracy <\/h3>\n\n\n\n
2. Higher Precision <\/h3>\n\n\n\n
3. Higher Coverage <\/h3>\n\n\n\n
4. Data Quality <\/h3>\n\n\n\n
5. Quality of methods and models <\/h3>\n\n\n\n