A New Approach to Model Verification, Falsification and Selection
This paper shows that a qualitative analysis, i.e., an assessment of the consistency of a hypothesized sign pattern for structural arrays with the sign pattern of the estimated reduced form, can always provide decisive insight into a model’s validity both in general and compared to other models. Qua...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2015-06-01
|
Series: | Econometrics |
Subjects: | |
Online Access: | http://www.mdpi.com/2225-1146/3/3/466 |
id |
doaj-42036d4587ed4e85a063d19cb4c84a09 |
---|---|
record_format |
Article |
spelling |
doaj-42036d4587ed4e85a063d19cb4c84a092020-11-25T00:30:24ZengMDPI AGEconometrics2225-11462015-06-013346649310.3390/econometrics3030466econometrics3030466A New Approach to Model Verification, Falsification and SelectionAndrew J. Buck0George M. Lady1Department of Economics Temple University, Philadelphia, PA 19122, USADepartment of Economics Temple University, Philadelphia, PA 19122, USAThis paper shows that a qualitative analysis, i.e., an assessment of the consistency of a hypothesized sign pattern for structural arrays with the sign pattern of the estimated reduced form, can always provide decisive insight into a model’s validity both in general and compared to other models. Qualitative analysis can show that it is impossible for some models to have generated the data used to estimate the reduced form, even though standard specification tests might show the model to be adequate. A partially specified structural hypothesis can be falsified by estimating as few as one reduced form equation. Zero restrictions in the structure can themselves be falsified. It is further shown how the information content of the hypothesized structural sign patterns can be measured using a commonly applied concept of statistical entropy. The lower the hypothesized structural sign pattern’s entropy, the more a priori information it proposes about the sign pattern of the estimated reduced form. As an hypothesized structural sign pattern has a lower entropy, it is more subject to type 1 error and less subject to type 2 error. Three cases illustrate the approach taken here.http://www.mdpi.com/2225-1146/3/3/466verificationfalsificationspecificationqualitative analysisentropyinherited restrictions |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Andrew J. Buck George M. Lady |
spellingShingle |
Andrew J. Buck George M. Lady A New Approach to Model Verification, Falsification and Selection Econometrics verification falsification specification qualitative analysis entropy inherited restrictions |
author_facet |
Andrew J. Buck George M. Lady |
author_sort |
Andrew J. Buck |
title |
A New Approach to Model Verification, Falsification and Selection |
title_short |
A New Approach to Model Verification, Falsification and Selection |
title_full |
A New Approach to Model Verification, Falsification and Selection |
title_fullStr |
A New Approach to Model Verification, Falsification and Selection |
title_full_unstemmed |
A New Approach to Model Verification, Falsification and Selection |
title_sort |
new approach to model verification, falsification and selection |
publisher |
MDPI AG |
series |
Econometrics |
issn |
2225-1146 |
publishDate |
2015-06-01 |
description |
This paper shows that a qualitative analysis, i.e., an assessment of the consistency of a hypothesized sign pattern for structural arrays with the sign pattern of the estimated reduced form, can always provide decisive insight into a model’s validity both in general and compared to other models. Qualitative analysis can show that it is impossible for some models to have generated the data used to estimate the reduced form, even though standard specification tests might show the model to be adequate. A partially specified structural hypothesis can be falsified by estimating as few as one reduced form equation. Zero restrictions in the structure can themselves be falsified. It is further shown how the information content of the hypothesized structural sign patterns can be measured using a commonly applied concept of statistical entropy. The lower the hypothesized structural sign pattern’s entropy, the more a priori information it proposes about the sign pattern of the estimated reduced form. As an hypothesized structural sign pattern has a lower entropy, it is more subject to type 1 error and less subject to type 2 error. Three cases illustrate the approach taken here. |
topic |
verification falsification specification qualitative analysis entropy inherited restrictions |
url |
http://www.mdpi.com/2225-1146/3/3/466 |
work_keys_str_mv |
AT andrewjbuck anewapproachtomodelverificationfalsificationandselection AT georgemlady anewapproachtomodelverificationfalsificationandselection AT andrewjbuck newapproachtomodelverificationfalsificationandselection AT georgemlady newapproachtomodelverificationfalsificationandselection |
_version_ |
1725326846711562240 |