Psychometric Evaluation of the Traditional Chinese Version of CCS-R Practicum Evaluation

Psychometric Evaluation of the Traditional Chinese Version of CCS-R Practicum Evaluation and the Assessment of the Counselling Competencies Among Young Peer Counsellors in Hong Kong

This study aims to translate the original Counselor Competencies Scale-Revised (CCS-R, English version) into traditional Chinese. It will then test the psychometric properties of the newly translated CCS-R to examine its factorial structure using both exploratory factor analysis (EFA) and CFA.

Study Overview

• Status: Completed
• Conditions: Peer Group
• Intervention / Treatment: Other: Evaluation of Counselling competencies

Detailed Description

Clinical supervisors are charged with facilitating the development of their supervisees toward becoming ethical and competent. In addition, clinical supervisors are expected to serve as gatekeepers for the profession and deny entry to students who demonstrate a deficiency of necessary competencies. Despite the developmental and remedial expectations for clinical supervisors, specific guidelines to direct clinical supervisors' evaluation of their supervisees' level of counseling competencies are limited. The lack of agreed-upon and standardized evaluation criteria for supervisees' minimum level of counseling competencies and the limited availability of tested assessments to measure supervisees' counseling competencies fosters subjectivity in supervisory assessment and potential remediation. Therefore, additional research is warranted relating to clinical supervisory evaluation instruments.

Supervisory evaluation is "the nucleus of clinical supervision". Specifically, "supervisors document and provide supervisees with ongoing feedback regarding their performance and schedule periodic formal evaluative sessions throughout the supervisory relationship". However, clinical supervisors are often uncomfortable in evaluating their supervisees. Nevertheless, effective and ethical supervision supports supervisees' development of counseling competencies in which supervisors provide their supervisees with both formative and summative evaluative feedback within the context of a strong supervisory alliance. Limited research was identified investigating supervisory evaluation processes with standardized assessment tools such as the counselling competencies in Hong Kong.

An initial quantitative investigation of the 23-item counselling competencies scale-revised (CCS-R) supported the construct validity (e.g., exploratory factor analysis identified a five-factor model [professional behaviors, professional behaviors, counseling skills, assessment and application, and professional dispositions], accounting for 72.61% of the variance), internal consistency reliability, interrater reliability (r ¼.570), and criterion-related validity (correlation between supervisees' practicum course grade and final CCS score, r ¼.407,) of the instrument. The researchers concluded that "the CCS is a promising instrument for assessment in counselor education and supervision". Nevertheless, qualitative data are warranted to evaluate the CCS with a sample of clinical supervisors and their supervisees around its (a) functionality in communication of supervisory feedback with the CCS, (b) consistency in CCS evaluation, and (c) emotional reactions to supervisory evaluation with the CCS. Therefore, this study aims to translate the original Counselor Competencies Scale-Revised (CCS-R, English version) into traditional Chinese. It will then test the psychometric properties of the newly translated CCS-R to examine its factorial structure using both exploratory factor analysis (EFA) and CFA.

• Study Type: Observational
• Enrollment (Actual): 208

Contacts and Locations

Study Locations

• China
  • Hong Kong, China
    • The University of Hong Kong

Participation Criteria

Eligibility Criteria

• Ages Eligible for Study: 18 years to 35 years (Adult)
• Accepts Healthy Volunteers: No
• Genders Eligible for Study: All

• Sampling Method: Non-Probability Sample

Study Population

Young people in Hong Kong who complete the training of peer counselling for smoking cessation or anti-drug abusing will be selected and invited to participate in the proposed study

Description

Inclusion Criteria:

• Aged 18-35.
• Completing the training of peer counselling for smoking cessation or anti-drug abusing
• Be able to speak Cantonese and read traditional Chinese.

Exclusion Criteria:

• Those who do not provide written consent.

Study Plan

How is the study designed?

Design Details

• Observational Models: Cohort
• Time Perspectives: Cross-Sectional

What is the study measuring?

Primary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Counselling Competencies	The counselling competencies scale-revised is a 23-item scale measuring Counselor Competencies. It includes two factors, which are counselling skills & therapeutic conditions with 12 items, and counselling dispositions &behaviors with 11 items. Each of the items has a range of 1-5 points (0 indicates poor performance, while 5 indicates performance exceeding expectations). The 12 and 11 components scores are summed to yield two scores, with a range of 12-60 points and 11-55 points respectively.	Baseline

Secondary Outcome Measures

Outcome Measure	Measure Description	Time Frame
Counselling performance assessment scores	Validated Counselling performance assessment Sheet	Baseline

Collaborators and Investigators

• Sponsor: The University of Hong Kong

Study record dates

Study Major Dates

• Study Start (Actual): September 15, 2020
• Primary Completion (Actual): September 20, 2020
• Study Completion (Actual): November 5, 2020

Study Registration Dates

• First Submitted: September 7, 2020
• First Submitted That Met QC Criteria: September 7, 2020
• First Posted (Actual): September 14, 2020

Study Record Updates

• Last Update Posted (Actual): November 9, 2020
• Last Update Submitted That Met QC Criteria: November 5, 2020
• Last Verified: September 1, 2020

More Information

Terms related to this study

• Other Study ID Numbers: CCS-R

Plan for Individual participant data (IPD)

• Plan to Share Individual Participant Data (IPD)?: Yes
• IPD Plan Description: The relevant anonymized patient-level data, full dataset, technical appendix, and statistical code are available on reasonable request. The approval from the Principal Investigator for the purpose of data use is required.
• IPD Sharing Time Frame: After the project is completed and the results of the project have been published
• IPD Sharing Access Criteria: Request could be sent to Principal Investigator (william3@hku.hk)
• IPD Sharing Supporting Information Type: Statistical Analysis Plan (SAP); Informed Consent Form (ICF)

Drug and device information, study documents

• Studies a U.S. FDA-regulated drug product: No
• Studies a U.S. FDA-regulated device product: No