A New Approach to Model Verification, Falsification and Selection

This paper shows that a qualitative analysis, i.e., an assessment of the consistency of a hypothesized sign pattern for structural arrays with the sign pattern of the estimated reduced form, can always provide decisive insight into a model’s validity both in general and compared to other models. Qua...

Full description

Bibliographic Details
Main Authors: Andrew J. Buck, George M. Lady
Format: Article
Language:English
Published: MDPI AG 2015-06-01
Series:Econometrics
Subjects:
Online Access:http://www.mdpi.com/2225-1146/3/3/466
id doaj-42036d4587ed4e85a063d19cb4c84a09
record_format Article
spelling doaj-42036d4587ed4e85a063d19cb4c84a092020-11-25T00:30:24ZengMDPI AGEconometrics2225-11462015-06-013346649310.3390/econometrics3030466econometrics3030466A New Approach to Model Verification, Falsification and SelectionAndrew J. Buck0George M. Lady1Department of Economics Temple University, Philadelphia, PA 19122, USADepartment of Economics Temple University, Philadelphia, PA 19122, USAThis paper shows that a qualitative analysis, i.e., an assessment of the consistency of a hypothesized sign pattern for structural arrays with the sign pattern of the estimated reduced form, can always provide decisive insight into a model’s validity both in general and compared to other models. Qualitative analysis can show that it is impossible for some models to have generated the data used to estimate the reduced form, even though standard specification tests might show the model to be adequate. A partially specified structural hypothesis can be falsified by estimating as few as one reduced form equation. Zero restrictions in the structure can themselves be falsified. It is further shown how the information content of the hypothesized structural sign patterns can be measured using a commonly applied concept of statistical entropy. The lower the hypothesized structural sign pattern’s entropy, the more a priori information it proposes about the sign pattern of the estimated reduced form. As an hypothesized structural sign pattern has a lower entropy, it is more subject to type 1 error and less subject to type 2 error. Three cases illustrate the approach taken here.http://www.mdpi.com/2225-1146/3/3/466verificationfalsificationspecificationqualitative analysisentropyinherited restrictions
collection DOAJ
language English
format Article
sources DOAJ
author Andrew J. Buck
George M. Lady
spellingShingle Andrew J. Buck
George M. Lady
A New Approach to Model Verification, Falsification and Selection
Econometrics
verification
falsification
specification
qualitative analysis
entropy
inherited restrictions
author_facet Andrew J. Buck
George M. Lady
author_sort Andrew J. Buck
title A New Approach to Model Verification, Falsification and Selection
title_short A New Approach to Model Verification, Falsification and Selection
title_full A New Approach to Model Verification, Falsification and Selection
title_fullStr A New Approach to Model Verification, Falsification and Selection
title_full_unstemmed A New Approach to Model Verification, Falsification and Selection
title_sort new approach to model verification, falsification and selection
publisher MDPI AG
series Econometrics
issn 2225-1146
publishDate 2015-06-01
description This paper shows that a qualitative analysis, i.e., an assessment of the consistency of a hypothesized sign pattern for structural arrays with the sign pattern of the estimated reduced form, can always provide decisive insight into a model’s validity both in general and compared to other models. Qualitative analysis can show that it is impossible for some models to have generated the data used to estimate the reduced form, even though standard specification tests might show the model to be adequate. A partially specified structural hypothesis can be falsified by estimating as few as one reduced form equation. Zero restrictions in the structure can themselves be falsified. It is further shown how the information content of the hypothesized structural sign patterns can be measured using a commonly applied concept of statistical entropy. The lower the hypothesized structural sign pattern’s entropy, the more a priori information it proposes about the sign pattern of the estimated reduced form. As an hypothesized structural sign pattern has a lower entropy, it is more subject to type 1 error and less subject to type 2 error. Three cases illustrate the approach taken here.
topic verification
falsification
specification
qualitative analysis
entropy
inherited restrictions
url http://www.mdpi.com/2225-1146/3/3/466
work_keys_str_mv AT andrewjbuck anewapproachtomodelverificationfalsificationandselection
AT georgemlady anewapproachtomodelverificationfalsificationandselection
AT andrewjbuck newapproachtomodelverificationfalsificationandselection
AT georgemlady newapproachtomodelverificationfalsificationandselection
_version_ 1725326846711562240