International Conference on Assessment and Learning (ICAL)

Follow

• 

  Transforming Assessment and Learning: Making the System Work. Proceeding of the 2022 International Conference on Assessment and Learning

  ACER Indonesia

• 

  Relationship between students’ economic, cultural, and social status, school climate and student achievement in Indonesia

  Alejandra Osses-Vargas, Ursula Schwantner, Ray Adams, and Nicole Wernert

  PISA 2018 data shows that, in Indonesia, the relationship between students’ economic, cultural, and social status and their scores on reading achievement is weak. However, there is great variation between schools in average reading achievement with over 40% of the explainable variation in reading achievement being between-schools. In addition, in Indonesia, there is low social diversity across schools (students within schools are likely to be of similar economic, cultural, and social background). These conditions raise the question of whether school factors play a role – specifically whether school climate has a compensating, mediating or moderating effect on the relationship between ... View More

• 

  Item development and psychometric testing of Work Stress Scale

  Andhita Ramadhania Pristiawati, Laura Francisca Sudarnoto, and Angela Oktavia Suryani

  In 2020, the COVID-19 pandemic demanded employees work from home (Ishak & Mangundjaya, 2020). The work-from-home regulation provides several advantages, including high work flexibility. However, this regulation also creates excessive workloads and requires employees to work overtime due to various challenges from superiors with short deadlines. This situation encouraged researchers to develop an accurate psychological scale to identify the employees/ working stress. The scale comprised physical and mental individual responses to managing their uncomfortable work environment. It consists of 48 items measuring four dimensions: role overload, role conflict, role ambiguity, and role responsibility. The participants responded to the items by ... View More

• 

  Adaptation of three psychological measurement instruments assessing the impact of the COVID-19 pandemic: Fear of COVID-19 scale, coronavirus anxiety scale, and altruism

  Angela Oktavia Suryani, Laura Fransisca Sudarnoto, and Benedicta Prihatin D. Riyanti

  The COVID-19 pandemic has been going on for more than two years and has caused problems for the world community. One of the impacts of COVID-19 is psychological barriers, including decreased well-being, increased stress, anxiety, depression, loss of family members, and being laid off. Is there still energy in a difficult situation like this to give empathy and have a sense of wanting to help without reward (altruism)? The psychological condition of the impact of COVID-19 is the background for the need to carry out valid and reliable psychological measurements. This study aims to identify the psychometric properties of three ... View More

• 

  Confirmatory factor analysis of the Perception of Academic Stress Scale (PAS)

  Damajanti Kusuma Dewi, Miftakhul Jannah, and Ira Darmawanti

  Stress is a condition that must be experienced by humans, including students. This happens because every student will always be faced with a condition to meet the demands of the environment. Students will experience stress if they feel they do not have the ability to meet these academic demands. Therefore, an instrument is needed that can measure academic stress felt by students. This study aims to test the construct validity of the Perception of Academic Stress Scale (PAS)-Adaptation of Bedewy & Gabriel. Before conducting factor analysis, the adaptation and modification process of the instrument was carried out. The adaptation process ... View More

• 

  Psychometric properties of the Dyadic Coping Inventory (DCI)

  Amorita Christella Anggamsari and Fitri Andriani

  A survey conducted by The Indonesian Central Bureau of Statistics (Badan Pusat Statistik/BPS Indonesia) last year has found that the divorce rate in Indonesia had increased up to 53,50% compared to the data in 2020, and more than half of the divorce cases happened because of “unsolved conflicts between couples”. Out of various studies on marital or romantic relationships done internationally, it suggests that dyadic coping could be the protective factor in the relationship between stress and the couples’ well-being. According to a meta-analysis study held in 2015 along with systematic literature reviews published in 2019 and 2022 regarding the ... View More

• 

  A formative evaluation of the program for student representatives in a university discipline panel

  Diana Genevive Layag

  The university employs a representation of different sectors in the academic community when dealing with major student conduct violations. Among them is the representative of the students. At the time of the study, the student representatives were qualified students who were recruited and trained to become part of the university discipline case conference panel. Upon successful completion of the training, these students were appointed to be members of a program for the pool of student representatives who sit as part of the university adjudicating body, which makes decisions for the university student discipline cases. Terminally, the researcher wanted to improve ... View More

• 

  Validation of the Child and Adult Social Support Scale (CASSS) which measures social support in the Indonesian version

  Endah Mastuti, Fajrianthi, and Fitri Andriani

  Social support has an important role, so that students in online learning can reduce the various problems they face. Social support here comes from parents, teachers, classmates, close friends, and the school itself as an institution. Based on this, it is necessary to do research related to social support to get an overview of the support from whom students need in online learning. Furthermore, this can be used as input to intervene in the problems faced by students. To conduct this research, it is necessary to have a measuring tool to conduct social support research. One of the comprehensive measuring ... View More

• 

  Development of educational quality mapping instruments (IP-SNP) in West Java

  Rina Mutaqinah, Bambang Sumintono, and Yanti Triatna

  Decision-making must be based on valid data, as well as decision-making in the field of education. It is very important to have a valid instrument, therefore it is necessary to develop an educational quality mapping instrument that can measure the achievement of the quality of education. This instrument was developed based on educational quality standards, namely the competency quality of graduates, content, process, assessment, educators and education personnel, infrastructure, management, and financing. The purpose of this study was to obtain an instrument that has high validity. The educational quality mapping instrument (IP-SNP) uses a rating scale, collecting data through a ... View More

• 

  Simulation of comparing the sensitivity between response model and response time model detecting aberrant behavior

  Danang Kamal Musthafa and Suprananto

  This study aims to determine whether there is a difference in detection rates between response model and response time model to detect aberrant behavior. Also, to determine examinee’s ability estimation accuracy of each model along with checking the strengths and weakness when there is an aberrant behavior in testing data especially CBT. This research is a simulation study where concentrate on test-length, sample-size, and aberrant level with 50 replications. Analyzing parameter recovery from replicated data to check the strengths and weaknesses of each model. Further, comparing the lz person-fit that using response’s data and response time’s data to see which ... View More

• 

  Item development and psychometric assessment of a pilots' well-being scale: A study on Indonesian commercial pilots

  Patricia Yora Wenas, Angela Oktavia Suryani, and Laura Fransisca Sudarnoto

  Flight success and accidents rely on the pilot's condition. To date, there is no psychometrically tested instrument to measure the psychological well-being of pilots. This study aims to develop items for measuring the well-being of commercial pilots in Indonesia. The constructs, dimensions, and indicators were formulated through literature reviews and interviews with pilots about their well-being. We develop well-being as a state in which a person feels positive, healthy, prosperous, comfortable, and valued in their work, able to control and contribute to the social environment. The instrument conveyed six dimensions, namely (1) positive emotion, (2) health, (3) competence, (4) recognition, ... View More

• 

  Validity evidence based on content: Controversies and quantification

  Agung Santoso, Alice Whita Savira, and Robertus Landung Eko Prihatmoko

  Validity is a crucial issue in test development because it represents the accuracy of test score interpretation in describing the measured attribute or construct. Among validity evidence that can be collected to support test score interpretation, the one based on test content incited controversies. The content-based validity evidence includes analyses of the relationship between test content and the construct the test purported to measure. Some authors opposed the use of such evidence in the validation process, arguing that the evidence can only provide hypotheses to be tested in the subsequent processes. Other authors argued that the content validation process provided ... View More

• 

  Are girls more resilient in literacy and numeracy than boys?

  Sri Irene Astuti Dwiningrum, Rahmawati Rahmawati, Aditya Aditya, Dian Rahdiani, Haryo Susetiyo, and Mega Riyanti Bayu Putri

  Based on data from the Indonesian Child Protection Commission (KPAI) from 2011 to 2016, there were 7,698 cases of children in conflict with the law, 2,435 cases of children in the education sector (perpetrators of student brawls, perpetrators of violence at school, and so on), and 1,709 cases of children related to pornography and cybercrime. The data shows the importance of student resilience in order to fortify themselves from various behaviors that can harm their future. The formation of student resilience has not been designed comprehensively in the learning process at school. Therefore, there are still many students who have ... View More

• 

  Is it necessary to use two-way items? Testing the effects of using favourable and unfavourable items

  Sukaesi Marianti, Dera Kariema, Puri Intan Larasati, Dhia Ulfah Purwati, and Nur Hasanah

  The topic of ethnicity is a topic that is often discussed in research, especially psychology research. Considering that Indonesia is a country with many ethnicities, therefore, ethnicity is a very important and relevant topic to be discussed in many studies. In this regard, robust tests measuring ethnicity are needed to collect data and further the data can be validly interpreted. The purpose of this study was to psychometrically evaluate the effects of the method of using two-way items (favorable and unfavorable) on two scales, Ethnic Experience and Ethnic Identity. This evaluation will lead to an evaluation of possible new factors ... View More

• 

  A policy model for implementing online social moderation to develop professional learning standards

  Pina Tarricone

  Social moderation is critical to ensuring shared understandings of student performance or product quality, assessment standards and consistent results of teacher qualitative judgments. Traditionally, social moderation meetings were conducted face to face. Communication technologies and online scoring systems enable teachers, in any location, to engage in online social moderation (OSM). Reliability data from analytical marking and comparative judgement online scoring systems can inform teachers' understanding of what constitutes quality, and OSM serves to develop communities of judgement. The purpose of this study was to investigate if these systems support OSM outcomes, and if this approach was advantageous. In this paper, ... View More

• 

  Introducing the Education Technology Value Evaluation Tool for Schools

  Ralph Saubern, Pauline Taylor-Guy, and Fabienne van der Kleij

  Despite the enthusiasm for technology in school education, the importance attributed to it by policymakers, educators, students and parents, and the extensive impact of the changes in practices and provision related to the adoption of digital technologies, research has provided little evidence that the adoption of digital technologies has led to improved outcomes for learners. Given the significant, ongoing investment in technology and research evidence that technology has potential to improve learning outcomes, it is timely for education systems and schools to have access to tools and frameworks that can support effective use of technology in education. This paper introduces ... View More