{"id":1692,"date":"2024-06-18T15:52:54","date_gmt":"2024-06-18T15:52:54","guid":{"rendered":"https:\/\/www.xome.com\/blog\/?p=1692"},"modified":"2024-06-18T15:56:30","modified_gmt":"2024-06-18T15:56:30","slug":"why-confidence-scores-matter-in-automated-valuation-models","status":"publish","type":"post","link":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/","title":{"rendered":"Why Confidence Scores Matter in Automated Valuation Models"},"content":{"rendered":"\n

Automated valuation models (AVMs) are helpful for providing quick property valuations, but their accuracy varies depending on the AVM used.  <\/p>\n\n\n\n

Different AVMs<\/a> are built using different types of machine learning algorithms, so they each have their own level of accuracy. One AVM may produce an entirely different result than another, and they are not always the most precise. <\/p>\n\n\n\n

For instance, the AVM that Xome\u00ae uses to calculate the Xome Value<\/a>\u00ae of properties has a different level of accuracy than other real estate applications. The level of accuracy is determined using a \u201cconfidence score,\u201d which represents a measure of the reliability associated with the AVM in use. You will see a confidence score alongside the Xome Value where it is generated for auction properties. <\/p>\n\n\n\n

Without having trust in an AVM, what is the point of using it? That\u2019s where confidence scores come in. They provide users with a frame of reference, giving them a look at how much they may be able to trust a particular AVM. Knowing how accurate and reliable the model\u2019s results are, buyers, sellers, and real estate professionals can feel secure about their decisions.  <\/p>\n\n\n\n

The importance of confidence scores in real estate valuations\u00a0<\/h2>\n\n\n\n

AVM confidence scores are important for a variety of reasons. Not only do they measure the accuracy and reliability of the model\u2019s final estimate, but they also may provide accountability of the model itself. This helps to battle regressivity in AVMs and reduce bias. <\/p>\n\n\n\n

They are especially helpful for risk assessment. Confidence scores can set risk thresholds by both the model and its users when evaluating AVM estimates.  <\/p>\n\n\n\n

Developers may design the AVM with specific thresholds to determine the level of confidence it assigns to each valuation. By establishing a minimum confidence score threshold, the model can filter out AVM estimates that do not meet a desired level of confidence. As a result, the AVM may not generate an estimate when it has insufficient data and a confidence score below a certain threshold. <\/p>\n\n\n\n

Similarly, the AVM user can also filter out properties from their research if the final estimate\u2019s confidence score does not meet their expectations. This way they can avoid relying on less reliable estimates that could spoil any real estate plans they have. <\/p>\n\n\n\n

How do AVM confidence scores work?\u00a0<\/h2>\n\n\n\n

Confidence scores are calculated using a metric called the Forecast Standard Deviation (FSD<\/a>). This metric is the standard deviation of the percentage sales errors and shows the level of variability in the AVM estimate. The percentage sales error is the ratio of sales error divided by selling price.  <\/p>\n\n\n\n

The lower the FSD percentage is, the higher the probability of accuracy is for the AVM estimated value. But the FSD is different from the confidence score, which has a higher probability of accuracy the higher the confidence score is.  <\/p>\n\n\n\n

When looking at property listings on Xome, you will notice the Xome Value alongside a range of estimated prices. The high and low values are derived from the FSD value.<\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
<\/div>\n\n\n\n

The confidence score uses the FSD percentage to subtract it from 100%. If the FSD is 10%, the confidence score is calculated using the following formula:\u00a0<\/p>\n\n\n\n

100% \u2013 FSD 10% = 90% Confidence Score <\/strong> <\/p>\n\n\n\n

Keep in mind that you cannot compare the confidence scores of one AVM to those of a different AVM provider. Each AVM provider defines and uses their own FSD and confidence scores, and the calculation methods may vary. <\/p>\n\n\n\n

A high confidence score vs. a low confidence score<\/h2>\n\n\n\n

The higher the confidence score is, the lower the level of risk there is associated with the estimated value based on the available property data. On the other hand, a lower confidence score indicates a higher degree of uncertainty, suggesting that the valuation has higher risk and may be less reliable.  <\/p>\n\n\n\n

However, interpreting high and low confidence scores does not necessarily translate into \u201cgood\u201d or \u201cbad\u201d scores. The exact threshold for categorizing as good or bad is subjective. It depends on several factors, such as the purpose of the valuation and the risk tolerance of the user. <\/p>\n\n\n\n

A \u201cgood\u201d confidence score might be considered above a certain threshold, such as 70%, 80%, or 90%, depending on the specific AVM used. The person using the AVM determines these thresholds. <\/p>\n\n\n\n

Some users may consider a confidence score above 70% or 80% as good, while others may have more conservative thresholds of above 90%. The 90% group could consider anything below that as “bad” and would filter those out of their research. <\/p>\n\n\n\n

Just because a confidence score might appear good to one person, it may not be considered the same to another.  <\/p>\n\n\n\n

The evolving role of confidence scores in AVMs\u00a0<\/h2>\n\n\n\n

Confidence scores are not consistent across different AVM providers and their interpretation also differs from user to user. Even so, they are still a valuable resource for getting a rough idea of the home\u2019s value.  <\/p>\n\n\n\n

The more standardized AVMs become, standardization of confidence scores may soon follow \u2014 and the easier it will be to compare them. <\/p>\n\n\n\n

See our confidence scores in action while searching properties for auction<\/a> on Xome.com. <\/p>\n\n\n\n

 <\/h2>\n","protected":false},"excerpt":{"rendered":"

Explore how confidence scores in automated valuation models (AVMs) can help ensure accuracy and reliability in property valuations. <\/p>\n","protected":false},"author":2,"featured_media":1693,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[107],"tags":[109,135,118],"class_list":["post-1692","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-real-estate-tech","tag-automated-valuation-model","tag-confidence-score","tag-technology"],"yoast_head":"\nWhy Confidence Scores Matter in Automated Valuation Models - Xome | Blog<\/title>\n<meta name=\"description\" content=\"Explore how confidence scores in automated valuation models (AVMs) can help ensure accuracy and reliability in property valuations.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Why Confidence Scores Matter in Automated Valuation Models\" \/>\n<meta property=\"og:description\" content=\"Explore how confidence scores in automated valuation models (AVMs) can help ensure accuracy and reliability in property valuations.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/\" \/>\n<meta property=\"og:site_name\" content=\"Xome | Blog\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/XomeRealEstate\" \/>\n<meta property=\"article:published_time\" content=\"2024-06-18T15:52:54+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2024-06-18T15:56:30+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.xome.com\/blog\/wp-content\/uploads\/2024\/06\/flpc9_vocj4.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1600\" \/>\n\t<meta property=\"og:image:height\" content=\"1067\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Xome\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@XomeRealEstate\" \/>\n<meta name=\"twitter:site\" content=\"@XomeRealEstate\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Xome\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Why Confidence Scores Matter in Automated Valuation Models - Xome | Blog","description":"Explore how confidence scores in automated valuation models (AVMs) can help ensure accuracy and reliability in property valuations.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/","og_locale":"en_US","og_type":"article","og_title":"Why Confidence Scores Matter in Automated Valuation Models","og_description":"Explore how confidence scores in automated valuation models (AVMs) can help ensure accuracy and reliability in property valuations.","og_url":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/","og_site_name":"Xome | Blog","article_publisher":"https:\/\/www.facebook.com\/XomeRealEstate","article_published_time":"2024-06-18T15:52:54+00:00","article_modified_time":"2024-06-18T15:56:30+00:00","og_image":[{"width":1600,"height":1067,"url":"https:\/\/www.xome.com\/blog\/wp-content\/uploads\/2024\/06\/flpc9_vocj4.jpg","type":"image\/jpeg"}],"author":"Xome","twitter_card":"summary_large_image","twitter_creator":"@XomeRealEstate","twitter_site":"@XomeRealEstate","twitter_misc":{"Written by":"Xome","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/#article","isPartOf":{"@id":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/"},"author":{"name":"Xome","@id":"https:\/\/www.xome.com\/blog\/#\/schema\/person\/9ba9f5a5815a35c244a30044cd1fb392"},"headline":"Why Confidence Scores Matter in Automated Valuation Models","datePublished":"2024-06-18T15:52:54+00:00","dateModified":"2024-06-18T15:56:30+00:00","mainEntityOfPage":{"@id":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/"},"wordCount":871,"publisher":{"@id":"https:\/\/www.xome.com\/blog\/#organization"},"image":{"@id":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/#primaryimage"},"thumbnailUrl":"https:\/\/www.xome.com\/blog\/wp-content\/uploads\/2024\/06\/flpc9_vocj4.jpg","keywords":["automated valuation model","confidence score","technology"],"articleSection":["Real Estate Tech"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/","url":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/","name":"Why Confidence Scores Matter in Automated Valuation Models - Xome | Blog","isPartOf":{"@id":"https:\/\/www.xome.com\/blog\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/#primaryimage"},"image":{"@id":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/#primaryimage"},"thumbnailUrl":"https:\/\/www.xome.com\/blog\/wp-content\/uploads\/2024\/06\/flpc9_vocj4.jpg","datePublished":"2024-06-18T15:52:54+00:00","dateModified":"2024-06-18T15:56:30+00:00","description":"Explore how confidence scores in automated valuation models (AVMs) can help ensure accuracy and reliability in property valuations.","breadcrumb":{"@id":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/#primaryimage","url":"https:\/\/www.xome.com\/blog\/wp-content\/uploads\/2024\/06\/flpc9_vocj4.jpg","contentUrl":"https:\/\/www.xome.com\/blog\/wp-content\/uploads\/2024\/06\/flpc9_vocj4.jpg","width":1600,"height":1067,"caption":"person using laptop with another person pointing at the screen"},{"@type":"BreadcrumbList","@id":"https:\/\/www.xome.com\/blog\/why-confidence-scores-matter-in-automated-valuation-models\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Blog","item":"https:\/\/www.xome.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Real Estate Tech","item":"https:\/\/www.xome.com\/blog\/category\/real-estate-tech\/"},{"@type":"ListItem","position":3,"name":"Why Confidence Scores Matter in Automated Valuation Models"}]},{"@type":"WebSite","@id":"https:\/\/www.xome.com\/blog\/#website","url":"https:\/\/www.xome.com\/blog\/","name":"Xome | Blog","description":"","publisher":{"@id":"https:\/\/www.xome.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.xome.com\/blog\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.xome.com\/blog\/#organization","name":"Xome | Blog","url":"https:\/\/www.xome.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.xome.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.xome.com\/blog\/wp-content\/uploads\/2022\/10\/xome-logo-blaze.svg","contentUrl":"https:\/\/www.xome.com\/blog\/wp-content\/uploads\/2022\/10\/xome-logo-blaze.svg","width":64,"height":30,"caption":"Xome | Blog"},"image":{"@id":"https:\/\/www.xome.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/XomeRealEstate","https:\/\/x.com\/XomeRealEstate","https:\/\/www.instagram.com\/xome_com","https:\/\/www.linkedin.com\/company\/xome"]},{"@type":"Person","@id":"https:\/\/www.xome.com\/blog\/#\/schema\/person\/9ba9f5a5815a35c244a30044cd1fb392","name":"Xome","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/6a23391c131d2bcbe1b80b2697e5f17546685a7b6e8f4f12dc0324ab4d535802?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/6a23391c131d2bcbe1b80b2697e5f17546685a7b6e8f4f12dc0324ab4d535802?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/6a23391c131d2bcbe1b80b2697e5f17546685a7b6e8f4f12dc0324ab4d535802?s=96&d=mm&r=g","caption":"Xome"},"url":"https:\/\/www.xome.com\/blog\/author\/jfritsche\/"}]}},"_links":{"self":[{"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/posts\/1692","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/comments?post=1692"}],"version-history":[{"count":6,"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/posts\/1692\/revisions"}],"predecessor-version":[{"id":1701,"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/posts\/1692\/revisions\/1701"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/media\/1693"}],"wp:attachment":[{"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/media?parent=1692"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/categories?post=1692"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.xome.com\/blog\/wp-json\/wp\/v2\/tags?post=1692"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}