Deakin Lab for the Meta-Analysis of Research (DeLMAR)

The aim of DeLMAR is to bring together scholars across Deakin involved with meta-analysis and research synthesis.

A unifying focus of the lab’s work is the development and application of methods that are shared across research problems in the social and natural sciences. A second unifying focus is an emphasis on producing evidence-based knowledge that can inform policy across disciplinary boundaries.

Our team

Centre Co-Directors

Name
Marketing
Chris Dubelaar  
Psychology
Emily Kothe 
Economics
Chris Doucouliagos

Members

Faculty of Arts and Education

Name
Brian Doig
Senior Lecturer in Education (Mathematics), School of Education

Alfred Deakin Institute

Name
Amanuel Elias
Research Fellow, Faculty of Arts and Education
Ayuba Issaka
Faculty of Health
Matteo Vergani
Associate Research Fellow, Faculty of Arts and Education

Faculty of Business and Law

Name
Dr Josh Newton
Senior Lecturer in Marketing
Tom Stanley
Professor of Meta-Analysis
Associate Professor Andrea Vocino
Department of Marketing

Faculty of Health

Name
Professor Michael Berk
Alfred Deakin Professor, School of Medicine and Barwon Health
Dr Brisa S. Fernandes
Alfred Deakin Postdoctoral Research Fellow, School of Medicine
Associate Professor Matthew Fuller-Tyszkiewicz
School of Psychology
Dr Emily Kothe
Lecturer, School of Psychology
Dr Jarrad Lum
Senior Lecturer, School of Psychology
Dr Helen Macpherson
NHMRC-ARC Dementia Research Postdoctoral Fellow
Professor Ralph Maddison
Professor in Physical Activity and Disease Prevention, School of Exercise and Nutrition Science
Professor Caryl Nowson
Chair of Nutrition and Ageing, Institute for Physical Activity and Nutrition (IPAN)
Dr Jonathan Rawstorn
Research Fellow, School of Exercise and Nutrition Science

Associate Members

Name
Professor John Ioannidis
C. F. Rehnborg Professor in Disease Prevention, School Of Medicine, Stanford Prevention Research Center, Stanford University
Dr Natalina Zlatevska
Senior Lecturer of Marketing, University of Sydney
Professor Nicholas Feltovich
Monash University
Associate Professor Bart de Jong
Australian Catholic University  
Stephen Holden
Honorary Associate Professor in Management, Macquarie Graduate School of Management
Tomáš Havránek
Associate Professor, Charles University and Czech National Bank

PhD Students

Faculty of Business and Law

Name
Kaushalya Nallaperuma 
Trang Tran
Isuru Kirige
Maria Klona
Yin Chen
Matthew Larkin

DeLMAR Launch

DeLMAR Launch, 9th October 2017

DeLMAR was launched on Monday 9 October 2017 with a Keynote Address by Professor John P.A. Ioannidis, from Stanford University, and speakers Professor Peter Hodgson, Professor Mike Ewing, and the centre co-directors Professor Chris Dubelaar and Professor Chris Doucouliagos.

Professor Ioannidis' keynote presentation was titled Meta-analyses and meta-research: evidence synthesis and bird's eye views of science.

Welcome to DeLMAR

Professor Tom Stanley introduces Deakin Laboratory for the Meta-Analysis of Research (DeLMAR) in the Deakin Business School.

MAER-Net Colloquium

DeLMAR will host the MAER-Net Colloquium, October 4th to 5th, 2018.

The Faculty of Business and Law will host the 2018 Meta-Analysis of Economics Research Network (MAER-Net) Colloquium October 4-5, 2018. Please click on the link above to register.

MAER-NET is an open international network of scholars committed to improving economic and social sciences through meta-analysis.

See this flyer for more details and also MAER-Net's Workshops and Colloquia webpage for updates. We look forward to seeing you at Deakin!

Events

2018 events

Meta-analysis in Health and Medicine

DeLMAR hosted a well-attended workshop on Meta-analysis in Health and Medicine on Thursday 9 March at Burwood Corporate Centre. A unifying focus of DeLMAR's work is the development and application of meta-analytic methods to research questions and problems in the social and natural sciences.

Tom Stanley, Professor of Meta-Analysis in the Faculty of Business and Law, and Emily Kothe, School of Psychology, discussed how meta-analytic methods are applied in a health context.

2017 events

DeLMAR ANZMAC Meta-Analysis Workshop

DeLMAR was a bronze sponsor of ANZMAC 2017, held at RMIT, and hosted a highly successful Meta-Analysis workshop on Thursday 7 December, focussing on the motivation and scoping of meta-analytic studies, search terms and search locations, and hands-on exercises on extracting and coding data and calculating effect sizes and weights. Presenters also reviewed standards for Systematic Reviews, the PRISMA and MAER-Net guidelines, and how meta-analysis helps advance knowledge.

The presenters were (from left to right) Professor Tom Stanley, Dr Josh Newton, Professor Chris Dubelaar, and Professor Stephen Holden (Macquarie University)

An Introduction to Meta-Analytic techniques in Marketing and Management, Thursday 26 October 2017

Have you ever thought about running a meta-analysis but weren’t sure how to do one? Then this is the workshop for you! Using datasets from published papers and taught by people who have published meta-analyses in prestigious journals, this hands-on half-day workshop will introduce you to the basics of how to:

  • Plan, conduct, and document a systematic search of the literature
  • Extract the relevant data from the papers you find
  • Convert the data you extract into the metrics required to conduct a meta-analysis
  • Conduct a basic meta-analysis
  • Test your data for basic problems of bias and heterogeneity
  • Report your meta-analytic findings

Workshop on the Meta-Analysis and Research Synthesis, 14th February 2017

Presenters: T.D Stanley (Hendrix College) and Chris Doucouliagos (Deakin)

In the first half of the workshop, Professor Stanley discussed meta-analysis methods and the synthesis of empirical research. The methods were illustrated with an example of the marriage premium and the baby penalty; do men gain from marriage and women lose from having children? In the second half of the workshop Chris Doucouliagos provided hands-on research synthesis training using data on the impact of private and public health expenditure on life expectancy and mortality.

Professor Chris Dubelaar - Calories Meta-Analysis workshop

Professor Chris Dubelaar's presents on the meta-analysis of the effect on both consumers and restaurateurs of printing calories on menus.

New publications

Ioannidis, J.P.A., Stanley, T.D. and Doucouliagos, C. (2017). “The power of bias in economics research,” The Economic Journal, 127: F236-265.

John Ioannidis (Stanford University, DeLMAR), Chris Dougcouliagos (Chair of Economics and DeLMAR) and Tom Stanley (DeLMAR) have published a paper, “The power of bias in economics research” as part of a The Economic Journal’s Feature: “The Confidence Crisis in Science.”

“The power of bias in economics research” is the first large-scale study of the bias, statistical power, and hence the scientific credibility of economics.

A survey of 64,076 economic estimates from 159 areas of research and 6,700 empirical studies finds that the median statistical power is 18%, or less. That is, the probability that an empirical economic investigation is able to identify what it seeks is usually 18%, or less. Impotence begets bias. This survey also identifies widespread bias. Typically, reported economic effects are inflated by 100% with one-third inflated by a factor of four or more.

In other words, over half of economic research results are reported to be twice as large as they actually are, and one-third are exaggerated to be four times too big.  Lastly, 90% of economics findings are under-powered, relative to the widely accepted convention that 80% defines ‘adequate’ power, for half of these areas of economics research.

This DeLMAR research collaboration has generated much discussion in the popular press:

Stanley, T.D, Doucouliagos, C. and Ioannidis, J.P.A., (2017). Finding the power to reduce publication bias, Statistics in Medicine, 10: 1580- 1598

In this paper, the DeLMAR research team of John Ioannidis (Stanford University, DeLMAR), Chris Doucouliagos (Chair of Economics and DeLMAR) and Tom Stanley (DeLMAR) introduce a new meta-analysis summary estimator, the weighted average of the adequately powered (WAAP), that they show to be as good as and often better than conventional meta-analytic summary statistics, notably random-effects (RE). Their simulations show that WAAP will have consistently smaller bias than RE when there is selective reporting (or publication bias) at no loss to its other statistical properties. When there is no selective reporting, the difference between RE's and WAAP's statistical properties is practically negligible.

From what this DeLMAR team learned by conducting these two research projects, we now recommend that all meta-analyses report both the WAAP and the median power for their area of research. This short 10 minute video shows how to calculate median power and WAAP.

Meta-Analysis of Economics Research (MAER) Network

MAER-Net is an international network of scholars committed to improving economic science through meta-analysis. The purpose of our network is to serve as a clearinghouse for research in meta-analysis and economics and to improve the communication among scholars in this rapidly growing field.

Learn more about MAER-NET

Attendees at the 2017 MAER-Net colloquim Zeppelin University, Friedrichshafen, Germany, 12-14 October, with Professor Chris Doucouliagos, Alfred Deakin Professor, Chair in Economics and DeLMAR Director and Professor Tom Stanley.

Professor Tom Stanley gave a keynote lecture, 'Recent developments: should we WAAP Economics' low power?'.

Previous Events

Keynote presentation

Tom Stanley gave an invited keynote lecture, “Meta-Analysis in the Social Science: An Introduction,’ at the “Frontiers of Transition Economics” conference at Kyoto University in Kyoto, Japan. The workshop was sponsored by the Kyoto Institute of Economic Research.

Meta-analysis seminars

Tom Stanley gave a meta-analysis seminar at the Institute of Economic Research at Hitotsubashi University in Tokyo in 2016.

Emily Kothe gave a seminar on ‘Conducting Meta-Analysis in R: A Practical Introduction’ on 30 May 2017 at Deakin University

Databases, publications, methods and working papers

The primary analytical tool used by DeLMAR is meta-regression analysis, the statistical analysis of all relevant and comparable research on a specific scientific issue or, in other words, it is quantitative research synthesis. We seek to estimate genuine empirical effects, to understand research heterogeneity and to correct specification and selection biases endemic in economics and the social sciences.

View DeLMAR's collection of databases

View DeLMAR's collection of publications, methods and working papers

Contact us

Professor of Marketing
Chris Dubelaar
+61 3 9244 3786
Email Chris Dubelaar

School of Psychology
Dr Emily Kothe
+61 3 924 45599
http://www.emilykothe.com
Email Emily Kothe