Journal of Neurosciences in Rural Practice

  Table of Contents 
Year : 2018  |  Volume : 9  |  Issue : 4  |  Page : 510-515  

Preliminary results of the macedonian-adapted version of ages and stages developmental questionnaires

1 SENCO/Special Educational Needs Coordinator, Trondheim International School, Trondheim, Norway
2 Department of Psychology, Pontifical Catholic University of Rio de Janeiro, Rio de Janeiro, Brazil
3 Center on Human Development, University of Oregon, Eugene, USA
4 College of Education and Technology, Eastern New Mexico University, USA and Visiting Professor, Amity Institute of Rehabilitation Sciences, Amity University, India and Expert, Academic Council on the United Nations (UN) System, USA
5 Institute of Special Education and Rehabilitation. Faculty of Philosophy University "Ss. Cyril and Methodius". Skopje, Republic of Macedonia

Date of Web Publication29-Aug-2018

Correspondence Address:
Dr Luis Anunciação
Department of Psychology, Pontifical Catholic University of Rio de Janeiro, Marquês de São Vicente, 225 - Gávea, Rio de Janeiro, RJ
Login to access the Email id

Source of Support: None, Conflict of Interest: None

DOI: 10.4103/jnrp.jnrp_61_18

Rights and Permissions

Context: Early detection of developmental problems is critical, and interventions are more effective when they are carried out early in a child's life. In Macedonia, there are only four centers providing early intervention services. Aims: In this research, we determined the reliability of the translation and adaptation of Ages and Stages Questionnaires 3rd edition (ASQ-3-M) for assessment of children aged 3–5 years old in Macedonia, and reported preliminary results of the gender differences in the development. Materials and Methods: ASQ-3-M was completed by 165 parents and 40 educators in seven kindergarten classrooms. Children were 3–5 years old. Statistical Analysis Used: Cronbach's alpha, Intraclass Correlation coefficient (ICC), and interrater reliability (IRR) were used to assess ASQ-3-M psychometric properties. The Bayesian t-test was performed to estimate the difference in means between males and females. Results: The Cronbach's alpha ranged from 0.65 to 0.87. The overall ICC was 0.89 (ranged from 0.8 to 0.95), which indicates a strong to almost perfect strength of agreement between test-retest. IRR correlation revealed an average of 0.88 (ranged from 0.74 to 0.95), suggesting that ASQ-3-M is reliable and stable. Conclusions: The results from the comparison between males and females on all dimensions of ASQ-3-M were not statistically significant (BF10 <3), indicating no significant gender difference. That said, the ASQ-3 is recommended for routine use in screening children aged 3–5 years old.

Keywords: Ages and stages questionnaire, Bayesian analysis, child development, developmental assessment, Macedonia

How to cite this article:
Stanoevska B, Anunciação L, Squires J, Singh A, Trajkovski V. Preliminary results of the macedonian-adapted version of ages and stages developmental questionnaires. J Neurosci Rural Pract 2018;9:510-5

How to cite this URL:
Stanoevska B, Anunciação L, Squires J, Singh A, Trajkovski V. Preliminary results of the macedonian-adapted version of ages and stages developmental questionnaires. J Neurosci Rural Pract [serial online] 2018 [cited 2019 May 26];9:510-5. Available from:

   Introduction Top

Early experiences affect the development of the brain and have a direct impact on how children develop their sociability, self-expression, independence, initiative, and social and emotional skills.[1],[2],[3] Once infancy is a crucial time for both physically and mentally in every human's life, measuring the development in young children promotes information that can be used to determine which groups of children are eligible for receiving further assistance and provides the opportunity for children to benefit from early intervention.

Several approaches have been used to assess young children's developmental outcomes and the results of psychometric testing, in general, and screening tools, in specific, accurately reflect children development, when the tool administered has adequate psychometric properties. From this standpoint, psychometric instruments must guarantee their validity and reliability. Validity refers to the accuracy of measurement for a specific purpose and is the extent to which the test measures what it says it measures. Reliability refers the degree to which an assessment instrument produces stable and consistent results each time it is used in the same setting with the same type of subjects.[4]

In spite of that, there is a lack of a screening and early identification system for preschool children in the Republic of Macedonia. Children are often not identified as having disabilities until they are 3 years or older and sometimes, not even until they start school (Dimitrova-Radojichikj, Chichevska-Jovanova, and Rashikj-Canevska, 2016). This situation can be partially explained because in Macedonia, there are only four centers that provide early intervention services and because of the absence of psychometric screening tools: Even if a wide range of screening tools is available to assess child development, before a local adaptation, their use is limited to the population from whom they were developed.[5]

The process of developing, adapting, and implementing screening tools to use with Macedonian children is vital to improve services for young children and help them to reach their full potential. With that said, the purpose of this study is to verify the reliability of the translated and adapted version of Ages and Stages Questionnaires, 3rd Edition (ASQ-3-M) with data gathered in Republic of Macedonia.

   Materials and Methods Top


This study included 165 Macedonian children at the age of 36, 48, and 60 months, their parents and their kindergarten teachers. Participants were randomly selected from 7 kindergartens in different parts in Skopje.

Measures: Ages and Stages Questionnaires, 3rd Edition

ASQ-3, was chosen as a study target because is currently the most used parent-completed developmental screener in the world [6] and has been successfully studied in different countries and cultures.[7],[8],[9]

The ASQ-3 consists of 21 questionnaires, for children from 2 to 66 months. Each questionnaire contains 30 questions composed by 6 questions for each domain: communication, gross motor, fine motor, problem solving, and personal-social. ASQ questions are written at the fourth to sixth grade reading level and can be administered as an interview for parents with low literacy levels and include illustrations that assist parents in understanding items. Parents indicate “yes,” “sometimes,” or “not yet” in response to each item, with point values of 10, 5, or 0, respectively.[10],[11]

Each domain score is independently and there are empirically derived cutoff scores to indicate whether the questionnaire falls within a normal developmental range based on chronological age, or if the score represents “at risk” or delayed development. The ASQ requires about 15 min to complete and 2–3 min to score.[12]

Children whose scores fall within the “typical” range or above the cutoff scores are considered to be developing appropriately and should continue the screening process at regular intervals. Children whose scores fall below the cut off score in any developmental area are recommended to receive further assessment. If a child's scores fall within the monitoring zone (1–2 standard deviations below the mean), specialized activities and repeat screening are recommended.[11],[12]


The ASQ was translated into Macedonian (i.e., ASQ-3-M) and necessary cross-cultural adaptations were made, and then it was back translated. The accuracy of the translation was evaluated and changes were made, when necessary, by members of the research team who were very proficient in both languages.

After this, the translated version was distributed and completed by 165 parents and by 40 teachers in their seven kindergarten classrooms over a 6 months' time period. Questionnaires were distributed to teachers and parents at the same time. A demographic form attached to the questionnaire asked for general family information on the child's gender, date of child's birth, parents' age, education level, gender, and nationality. The researcher personally traveled to all kindergartens and had meetings with directors, teachers, and the staff to explain the study, its goals, procedures, and steps. After teachers had given permission to participate, the study was presented to parents, and they gave their permission if they were willing to participate.

When parents returned the questionnaire, they received a duplicate copy of the same ASQ-3-M corresponding to their child's age to complete. They were distributed by researcher and teacher only in hard copy (some of the questionnaires for parents were distributed via teachers to the parents). Teachers and the researcher collected the questionnaires and remained parents to complete both questionnaires throughout the process. The researcher entered all study data into a secure database.

Statistical analysis

Internal consistency reliability was assessed by calculating the Cronbach's α coefficient and results equal or above 0.7 are considered acceptable.[13] To assess test-retest reliability, the parents were asked to complete the ASQ-3-M on their child and then, to complete the same questionnaire 2 weeks apart, blind to the outcomes of the first result. The intraclass correlation coefficient (ICC) was computed with the results. An ICC between 0.75 and 0.90 indicates good test-retest reliability.[4] Interrater reliability (IRR, a.k.a., Interobserver reliability) was estimated by using Pearson Product Moment Correlation in the results from the questionnaires completed by parents and kindergarten teachers for the same children.

To investigate how much males and females' results were different one from another in all domains of ASQ-3-M, since the small sample in this research, a Bayesian t-test was performed using with a prior width set at r = 0.707, which is recommended as the default value for this test.[14] Bayes factors provide a numerical value that quantifies how well a hypothesis predicts the empirical data relative to a competing hypothesis. The Bayes Factor (BF10) expresses the probability of the data in favor of H1 relative H0. If the BF10 is equal to 1, it indicates that the observed finding is equally likely under both hypotheses, if BF10 is >1 then the data provide support for the alternative hypothesis and if BF10 is <1 then the data provide support for the null hypothesis.[14],[15]

The significance threshold for Bayesian inference was set at BF10 >3 and for frequentist inference was set at P < 0.05. There was no missing value in dataset and data were analyzed by using R statistical software version 3.4.4[16] with tidyverse, BayesFactor [17] and psych [18] packages.

   Results Top

Of the 210 participants' approaches to take part in this study, 165 (78.6%) completed the ASQ: 3-M. These results are presented in [Table 1], which show the absolute frequency and percentage of each included sociodemographic variable.
Table 1: Reporting of demographic variables

Click here to view

The reliability was estimated by three different ways: Internal consistency with Cronbach's alpha, test-retest reliability by ICC and IRR by Pearson Product-Moment correlation. All results were significant, and the outcomes are reported in [Table 2].
Table 2: Reliability results for all 5 dimensions

Click here to view

Cronbach alpha is a test of internal consistency and the higher is the score, the better is the internal consistency. Test-retest provides clinicians with the assurance that the instrument measures the outcome the same way each time it is performed. Better reproducibility, measured by higher ICC, suggests better precision of single measurements, which is a requirement for better tracking of changes in measurement. IRR assess the degree to which different raters/observers give consistent estimates of the same phenomenon.

To decide which of two hypotheses is more likely given an experimental result, one must consider the ratios of their likelihoods. This ratio is called the Bayes Factor (BF), and BF10 reflects the likelihood of H1 compared to H0 given a set of data. BF is a continuous measure of evidence and results with values between 1 and 3 are seems as inconclusive, values between 3 and 10 are weak and >10 are generally seem as strong evidence. Results are reported in [Table 3].
Table 3: Mean, standard deviation and hypothesis testing

Click here to view

Despite the numerical difference, there were no evidence of a statistically difference between males and females in terms of their abilities. [Figure 1] displays the mean scores of all vb ariables of ASQ-3-M for males and females.
Figure 1: Gender differences (Bayes t-test)

Click here to view

   Discussion Top

To the best of our knowledge, this is the first study of the Macedonian version of ASQ-3, as well the first to investigate the gender differences in response to it. In terms of cultural and linguistic appropriateness for Macedonian children, some items underwent modifications to ensure words and phrases are semantically similar, with a minimum of wording changes. A similar process of item adaptation happened in other countries, such as Brazil,[7] Chile,[8] and China,[9] which points to the importance of the cross-cultural adaptation of psychological instruments before its implementation.[5]

The internal consistency of the questionnaire ranged between 0.65 and 0.87. These results were higher than studies in Portugal,[19] but were similar to other international studies, such as those conducted in China [9] and in Arabic countries.[20] This outcome indicates that although some items were changed, they retained their concepts and did not lose their original meanings. Test-retest reliability measures the stability of test outcomes over time and was estimated by having parents complete two ASQ-3-M' on the same child within a 2 weeks' interval. The ICC between scores of the two ASQ-3-M concludes the stability of the scores of ASQ-3-M. Similar findings were found in other studies.[10],[21]

The IRR refers to the agreement of test outcomes and was examined using Person Product Moment. The results between parents and kind garden teachers were lower than the original ASQ-3 study,[12] but showed a strong agreement between both parents and teachers. The literature about the agreement between professionals and parents led both results (high and low agreement) and this evidence and this results provides supporting to evidence of the agreement regarding child development.[22]

There were no significant differences between the groups with respect to all scales of ASQ-3-M. However, although these results did not show a statistically significant difference between genders on any of the ASQ-3-M domains, this could be seen as result of having small sample. Variations between men and women development can be found in the literature [12] and in other studies that used ASQ-3 was measurement tool.[23],[24]

Some limitations are presented in these results. This study included only children at preschool age (36, 48, and 60 months) and only in Skopje. For a valid normative study, a larger sample of at least 100 children at each age interval is needed, stratified on a national Macedonia sample. In addition, only paper questionnaires were used in this study and to truly reach diverse young children; an online system would be preferable, as this would reduce the time and energy needed for data collection in individual kindergarten classrooms throughout the country. However, the impact of the limitations was small, as can be seen in the findings of this study.

These issues aside, as mentioned earlier, the basis of adult health and well-being are built prenatally and during early childhood.[1],[3],[25] The availability of ASQ: 3-M opens up possibilities for examining child development in diverse cultural groups, as well as for effective cross-cultural comparisons of development.

It was concluded that the Macedonian version of the ASQ-3 questionnaire was successfully translated and adapted, with good internal consistency and reliability, which provide solid support for the use of the scale to measure domains of child development among children in Macedonia. While this study has demonstrated the potential ASQ-3-M, it also being extended in longitudinal and comparative ways.

Financial support and sponsorship

Authors would like to say thanks to “Singh & Yeh Foundation, USA” for partial financial support to this research study.

Conflicts of interest

Dr. Squires is an author of the ASQ and receives some royalties from its publication.

   References Top

Bick J, Nelson CA. Early adverse experiences and the developing brain. Neuropsychopharmacology 2016;41:177-96.  Back to cited text no. 1
Chen CY, Xie H, Filgueiras A, Squires J, Anunciação L, Landeira-Fernandez J. Examining the psychometric properties of the Brazilian ages & stages questionnaires-social-emotional: Use in public child daycare centers in Brazil. Child Fam Stud 2017;26:2412-25. Available from: [Last accessed on 2018 Jan 07].  Back to cited text no. 2
Winston R, Chicot R. The importance of early bonding on the long-term mental health and resilience of children. London J Prim Care (Abingdon) 2016;8:12-4.  Back to cited text no. 3
Sullivan GM. A primer on the validity of assessment instruments. J Grad Med Educ 2011;3:119-20.  Back to cited text no. 4
Sabanathan S, Wills B, Gladstone M. Child development assessment tools in low-income and middle-income countries: How can we use them more appropriately? Arch Dis Child 2015;100:482-8.  Back to cited text no. 5
Hornman J, Kerstjens JM, de Winter AF, Bos AF, Reijneveld SA. Validity and internal consistency of the ages and stages questionnaire 60-month version and the effect of three scoring methods. Early Hum Dev 2013;89:1011-5.  Back to cited text no. 6
Filgueiras A, Pires P, Maissonette S, Landeira-Fernandez J. Psychometric properties of the Brazilian-adapted version of the ages and stages questionnaire in public child daycare centers. Early Hum Dev 2013;89:561-76.  Back to cited text no. 7
Armijo I, Schonhaut L, Cordero M. Validation of the chilean version of the ages and stages questionnaire (ASQ-CL) in community health settings. Early Hum Dev 2015;91:671-6.  Back to cited text no. 8
Bian X, Yao G, Squires J, Hoselton R, Chen CI, Murphy K, et al. Translation and use of parent-completed developmental screening test in Shanghai. Early Child Res 2012;10:162-75. Available from: [Last accessed on 2018 Feb 07].  Back to cited text no. 9
Singh A, Squires J, Yeh CJ, Heo KH, Bian H. Validity and reliability of the developmental assessment screening scale. J Family Med Prim Care 2016;5:124-8.  Back to cited text no. 10
[PUBMED]  [Full text]  
Hix-Small H, Marks K, Squires J, Nickel R. Impact of implementing developmental screening at 12 and 24 months in a pediatric practice. Pediatrics 2007;120:381-9.  Back to cited text no. 11
Squires J, Bricker D. Ages & Stages Questionnaires. (ASQ-3[TM]): A Parent-Completed Child-Monitoring System. 3rd ed. Brookes Publishing Company; 2009. Available from: [Last accessed on 2018 Feb 09].  Back to cited text no. 12
Bowling A. Research Methods in Health Investigating Health and Health Services. Buckingham: Public Health; 2009. p. 1-525.  Back to cited text no. 13
Wagenmakers EJ, Love J, Marsman M, Jamil T, Ly A, Verhagen J, et al. Bayesian inference for psychology. Part II: Example applications with JASP. Psychon Bull Rev 2018;25:58-76.  Back to cited text no. 14
Stern HS. A test by any other name:P Values, bayes factors, and statistical inference. Multivariate Behav Res 2016;51:23-9.  Back to cited text no. 15
R Development Core Team [Internet]. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2017. Available from: [Last accessed on 2018 Jan 07].  Back to cited text no. 16
Rouder JN, Morey RD, Speckman PL, Province JM. Default bayes factors for ANOVA designs. Math Psychol 2012;56:356-74. Available from: [Last accessed on 2018 Jan 07].  Back to cited text no. 17
Revelle, W. psych: Procedures for Personality and Psychological Research, Northwestern University, Evanston, Illinois: USA, 2018. Available from: [Last accessed on 2018 Mar 13].  Back to cited text no. 18
Lopes S, Graça P, Teixeira S, Serrano AM, Squires J. Psychometric properties and validation of portuguese version of ages & stages questionnaires (3rd edition): 9, 18 and 30 questionnaires. Early Hum Dev 2015;91:527-33.  Back to cited text no. 19
Vameghi R, Sajedi F, Kraskian Mojembari A, Habiollahi A, Lornezhad HR, Delavar B, et al. Cross-cultural adaptation, validation and standardization of ages and stages questionnaire (ASQ) in Iranian children. Iran J Public Health 2013;42:522-8.  Back to cited text no. 20
Wei M, Bian X, Squires J, Yao G, Wang X, Xie H, et al. Studies of the norm and psychometrical properties of the ages and stages questionnaires, third edition, with a Chinese national sample. Zhonghua Er Ke Za Zhi 2015;53:913-8.  Back to cited text no. 21
Rescorla LA, Bochicchio L, Achenbach TM, Ivanova MY, Almqvist F, Begovac I, et al. Parent-teacher agreement on children's problems in 21 societies. J Clin Child Adolesc Psychol 2014;43:627-42.  Back to cited text no. 22
Zirakashvili M, Gabunia M, Tatishvili N, Ediberidze T, Lomidze G, Chachava T, et al. Cultural adaptation and psychometric validation of the ages and stages questionnaires for use in Georgia. Child Fam Stud 2017;27 739–749. Available from: [Last accessed on 2018 Jan 13].  Back to cited text no. 23
Wang MV, Lekhal R, Aaro LE, Holte A, Schjolberg S. The developmental relationship between language and motor performance from 3 to 5 years of age: a prospective longitudinal population study. BMC Psychol 2014;2:34. Available from: [Last accessed on 2018 Jan 17].  Back to cited text no. 24
Chen Y, Baram TZ. Toward understanding how early-life stress reprograms cognitive and emotional brain networks. Neuropsychopharmacology 2016;41:197-206.  Back to cited text no. 25


  [Figure 1]

  [Table 1], [Table 2], [Table 3]


    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
 Related articles
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

  In this article
    Materials and Me...
    Article Figures
    Article Tables

 Article Access Statistics
    PDF Downloaded16    
    Comments [Add]    

Recommend this journal