Thursday, April 03, 2025

AVETRA - Day 1 afternoon

 After lunch, I attend a session with Steven Hodge and Reshman Tabassum on 'provider practices to enhance curriculum relevance in dynamic industries. Reshman set the scene with a scenario. The project was to explore RTO methods of interporeting and translating training packages. Conruses were in vet nurising, agriculture and rural operations. Did the RTOs approach qualifications with different intended outcomes and purposes? Posited that learning qualifications lead to a specific occupation, is for multiples occupations and have cross or multi-sectional interest. Process on interpretation goes from pre-translation, to translation and then mobilisation. Pre-translation requires understanding VET system, provider organisation, students, industry, training context. Translation involves interpreting, organising, elaborating, framing and structuring (through the quality assurance processes). Mobilisation is a continuum between educator and resource 'delivery'. Used a series of interview vignettes to unpack the processes of interpretation. What is important here is that no matter how detailed or prescriptive a standard is, currency of the standards and how they may align with diverse contexts are not guaranteed. Educators will use agency to work with, around and outside of standards, as required, to bring about learning. 

Following is Karl Hartley from Epic Learning reporting on the ConCOVE funded project 'AI-generated assessments in vocational education: enhancing quality and accessibility through cognitive design'. Customisation of assessments is one way to meet individual learners' needs. Assessment writing is complex work and manual assessment development is slow, consistent and inequitable. How can AI be used with safety and integrity to assist. Use a case study of developing assessments for a 'trades essentials' micro-credentials. applied cognitive science, ethical AI and educator validation. Began by selection of GPT-based model. Prompt engineering informed the working memory theory. 3-rounds of subject matter expert review process, and stakeholder consultation. Gen AI can generate multiple-choice and short answer quesitons, adapt the tone and language complexity, contextualise questions by trade/experience and enable personalised based learner profile. Personalisation features include literacy-adjusted versions, industry-specific variants, support for neurodiverse learners (format, language). A robust AI workflow to develop generic base assessment, then use base assessment and use AI to apply customisation. Prompt engineering strategy included the use of chain of thought prompting, using variables around writing style. providing example questions, assessment guides and for Gen AI to produce in batches of 5 assessments. Development loop was taking too long and involved too much time. Now development 5 assessment in batches. Seek rapid initial feedback for a 'go or no go' call to do a full review. Flip the feedback from 'what is wrong' to 'what is good'. Provided example of how the process looked, prompts and outputs. 

Challenges include AI constantly evolving, AI have been heavily trained with US of A assessments and are biased and AI will make mistakes. Risk and mitigations of Ai hallucinations by using structured prompt design and ensuring a human view is added. Cultural bias with ethics review and co-design with Māori and Pasifica advisors. Need to be wary of over-reliance on AI and issues of privacy. Benefits include the ability to have more inclusive and relevant assessments for learners; reduced workload to get to a quality product for teachers; and an opportunity for greater consistency and innovation. Plans for the next steps are to seek learner feedback and validation; finalise an ethical framework, expand to writing assessments for other microcredentials and disseminate findings and guidance.

The project demonstrates viable use of AI in assesment design; establishes moderation alignment proof of concept; builds foundation for personalised learning, and aligns to system transformation. 

Then a session on 'Planning and Actioning VET Research Studies: issues to consider' with  Llandis Barratt-Pugh. Shared 10 'critical incidents' that have informed his research practice, each supported with the narrative of how these came about. Used autoethnography, critical incident technique, reconstructive memory theory and the experiential learning cycle. 

The pointers include: tell industry what you can do for them then listen to what they want doing; start with the end in mind and plan toward it with frequent monitoring; seek out lions in the field and engage them as mentors; gain top commitment or the project may be swept away; publicise research studies to gain collaborators; collaboration is the key to multiple publications; a research proposal should be developed by serendipity as we don not know what lies ahead; when confronted with data collection dilemmas the options are to change the plan, call for support and the wisdom to know which is best; the research plan should include resources and action to use the finding constructively; taking a framework from a close discipline may shed unique light on the data in a wat that has not be done before; and the only certainty about a research project is that it will not progress as planned!

After afternoon tea, Craig Butler presents on 'Uncovering the Complexity of VET Teacher Identity' which is part of his PhD study. Summarised his background and his interest in the topic. Provided a overview of the study, with a theoretic framework of 'funds of identity', the research methodology, participants (25 VET teachers) and analysis method. Shared some of the findings around practical funds of identity resources (experiences, across many specialised contexts within and without a field) of vocation focus, VET practitioner, learner (life-long learning), expert performer, mentor, non-vocation (hobby , community work etc.) and institutional funds of identity through organisation role, employment type, and employment status. 

Shared framework to visualise how participants, across their life-course, had at a point of time (the interviews) had a particular role identity. Implications include a need to better understand the integration of vocational and VET identities; and recommendations for further study. Shared how study could inform VET support of teacher identity and limitations of the study.

I offer the last session of the day, providing an update on our Gen AI projects with ' AI in Vocational Education and Training: Progressive learnings on the integration of Gen AI into vocational programmes'. The primary purpose was to provide an overview of the projects to date, the challenges and learnings and propose a way forward as to how VET can use AI to support learning and teaching.

AVETRA AGM is conducted and the conference reception and awards round of a busy day.


AVETRA - DAY one - morning

 At the annual AVETRA conference in Melbourne which runs for 3 days. Workshops focused on specific topics were head yesterday afternoon.

Today, there is a full programme of activities.

The conference is opened with a welcome to country and the conference with the AVETRA president Kira Clarke. Kira thanked the conference sponsors, the conference committee, and the conference abstract reviewers. New membership directory was launched to help people find VET research experts. Niall Smith provided a demonstration of how the site works. 

The first keynote is with Craig Robertson, presented his thoughts on 'when robots replace VET, what's next?' Discussed the springboard into the digital, the challenges of competency in Australia, the new potential for VET and the research challenge. Used the example o Kodak and their rejection of moving across to the digital and how that ended up in their demise in 2012. VET needs to meet the challenge now, as the implications for its future role and direction, need to be considered now, at the cusp of great change through the rapid changes which will impact not only on work but also across society.

Suggested looking at the special issue in 2016 of the International Journal of Training Research on competency education to review the challenges through the system. Summarised the way in which so much of our lives of being changed by the digital economy. Use Frey & Osborne (2013) - 47% of the jobs in the US at risk of automation over the nes 10 - 20 years. Australian Computer Society 2021 report that proposed that by 2034, automation would displace 2.7 workers, 56% who are male. David Autor proposed the hollowing out of the labour market and the delayering of the middle-management layer, in assessing the impact of digitisation, there is the move from skills substitution to task substitution. 

The OECD - do adults have the skills they need to thrive in a changing world, summarises the types of skills needed to move into the future. Challenges of the current competency regime for VET in Australia include 'designing down', constrained learning and unitised standards. The 'outcomes' education model is too focused on 'education's contribution to the economy' and that they contribute to 'increasing efficiency'. Therefore, there are to many 'products', too many unclimbed qualification ladders, outcomes for the labour market are too near-term, and inputs are proxy for quality.

So are 'robots' here yet? There are over 200 data centres in Victoria with plans to build another 3 +. Although some skills will become obsolete, there is still a need to be able to work with non-routine tasks and the demand for new workers is still high post-CoVID. Therefore VET needs to re-orientate towards thinking more about the types of application, skills and knowledge (ASK) that enable workers to move to work tasks that are not always clear cut. A progressive VET qualifications system needs to uncouple from division of labour, transferability, tertiary harmonisation, and manageable product set.  Research needs to shift towards an educational focus, have a cultural component, capability needs to be rebuild and collaboration is required. We need to bring the best aspects of capability and competency together. 

Following is a panel discussion on - the rise of applied research in TAFE - 2017 to 2025. The panel was chaired by Karen O'Reilly-Briggs. Karen opened with a overview of the nature of applied research and its journey across the TAFE contexts. 

Panel consisted of  Teressa Schmidt, Melissa Williams, Katrina Jojkity and Sam Duncan. Sam began with an overview of the work undertaken at Holmsglen. Provided an overview on TAFE's role in the research and innovation ecosystem. TAFE provided a point of difference as it is often hands-on, industry integrated and solution orientated. The objective is to use applied research to solve real-world industry problems. Often conducted by educators with industry expertise rather than traditional academic researchers. Often with SMEs and community organisations. The doing-using-interacting (DUI) model ensures applied research translates into practice. Investment and recognition needed to support along with clear role and strategy and the need to build capability among educators.

Summarised the evolution of the Centre of Applied Research and Innovation at Holmsglen. The centre raises the profile of applied research and innovation and develop a culture of applied research. Shared the outcomes and outputs over the last decade.

Katrina presented on the International Specialised Skills Institute (ISS )institute international practitioner fellowship programme, funded by the Victorian Skills Authority over the last 23 years. 196 fellowship programmes awarded leading to continuing improvement and innovation across the VET sector. Provided details of the fellowships, their foci and the role of applied research fellowships. Presented several examples, their work and the impact and the repository of the fellowship reports. 

Melanie shared the work undertaken at William Angliss Institute to encourage practitioner research. Melanie completed an ISSI fellowship in 2019 to bring the Basque County's EHAZI model of collaborative challenge-based learning. Then piloted the pedagogy in 2024, ongoing evaluation to inform the review of the Diploma qualification in 2026. Presented on the challenges and lessons learnt towards supporting practitioner research. 

Teressa on 'what is needed to elevate the potential of applied research in TAFE'. TAFE is already doing applied research, mostly unfunded or underfunded, not always well supported and has limited promotion. There are many benefits including innovation, building capability, future proofing, and opportunities for industry partnerships. Challenges are the need for resources, the precieved value, capability development and the 'cloak of invisibility'. New opportunities include TAFE Centres if Excellence, recognition of TAFE's expanded capability, Government initiatives to build and increase R & and engage more stakeholders in research with impact. Used Canada as an example where by the Canadian colleges and institutes are valued as critical Canadian R & D. Specific funding is available to colleges for R & D. Encouraged the connections with SMEs which make up 98% of businesses in Australia. Shared the TDA recommendations to encourage applied research. 

After morning tea, presentations begin. The sessions are organised into three streams.

First up, Don Zoellner on 'theorising the elusiveness of an integrated tertiary education system: mirage, chimera or talisman?' Presented his 'plausible probe' into the unrealisation of the integration of tertiary education. There is a need to test the theoretical constructs to advance policy development and implementation. He applied Foucauldian post-structualist discousres to analyse policy artefacts and used institutional logics to explore VET and HE governance through the plausiblity probe. Caveats include that there is no absolute truth but to identify knowledge/power types and who gets to say it. Who and what knowledge/power are made visible. Introduced institutional logics debates with origins in North America which is unrelated to European logics - but which were applied to Australian VET analysis by Wheelahan. Shared the orders - state, profession, market, corporation, family, religion, community and elemental categories - basis of norms, source of legitimacy, source of authority, sources of identity; basis of attention, basis of strategy, informal control mechanisms and economic system.   Explained the differences between theories, frames, narratives and entrenched practices as building blocks of institutional logics and ideologies (which guide political norms and actions). 

Summarised the historical background that make VET different from HE. Until the late 1990s, integration of VET and HE was not a problem! After that, VET training packages were built on a very restrictive interpretation of competency-based training and assessment. VET reform arose from industrial relations rather than education and training! unitised VET knowledge that fit with industrial awards could be monetised and sold in a competitive market. HE knowledge also monetised but at the course level, Introduction of the hierarchical Australian Qualifications Framework created further VET/HE integration as a problem.

Compared the governance of VET and HE with HE being bureaucratic, hierarchical, managerial capitalism. Fundamentally, VET and HE is conducted through different perspectives which have little in common, Harmonisation is difficult as each is structured differently and the social actors have deeply held feelings and perceptions of who they are, how they are constituted, their objectives and purpose etc. However, harmonisation may not be a good thing as each contributes in a different way.

Then 'Action research as professional development for VET teachers with Suzanne Francisco from Charles Sturt University. Detailed the study based on four action research teams. Today, focused on two - in beauty therapy and nursing. Focused on what enables and constrains middle-leaders in supporting the development of quality VET pedagogy. In the presentation discussed, how, what and why action research was used. Data analysis using inductive/deductive approaches including the practice architectures framework. Summarised the advantages of learning in and through action research. Presented the enablers and constraints of action research. 

A good range of learning this morning :) 











Monday, March 31, 2025

Future orientated learning and skills development for employability - book overview

 This book ' Future-oriented learning and skills development for employability: Insights from Singapore and some Asia-Pacific contexts', is edited by A.N. Lee and Y. Nie. The book is open access (via UTS) and published by Springer in 2024.

Most of the chapters report on work undertaken in Singapore, to enact the government's support of continuing skills development to ensure the populace is kept current in the face of rapid change.

The book has 21 chapters, organised into three sections -

- Future oriented learning and the development of graduates' work competencies

- enhancing adult workers' employability through ocntinuing education and training

- supporting workplace learning and skills development for individual and organisational growth

with an opening and closing chapter by the editors.

Some chapters of relevance to my own work:

- Innovative curriculum and instructional approaches for work and learning: Practical pathways and research perspectives by S. Chue, S. Billette, R. Tan, W. Goh, A. Leow and A. S-H. Chen. Postulates, through gathering on the work of the authors, the need to integrate the curriculum which prepares people for work, with career guidance to help them envisage their goals, post higher education. There is also importance in ensuring that the connections between the world of education/school and the world of work are kept current, accessible and effective.

-  Developing adaptibility for workplace preformance by S. Billett and A H. Le discusses the need to ensure that adaptive practices remain central to individual's future employability. Draws on the PIAAC data to argue that all workers need to maintain opportunities and skills to problem solve. In doing, individual workers' are able to maintain agency and continually hone, adapt, and innovate. Cultural and social factors create or limit affordances.

- Knowing in practice in situational sensemaking by R. Mazlan. Argues that sensemaking arises from experiences encountered within context.

All in, a good collection of contemporary chapters on the state of the play, mainly in Singapore, but also across to Australia. 



Monday, March 24, 2025

Guides from Deakin University - Gen AI in work-integrated learning

The Centre for Research in Assessment and Digital Learning (CRADLE) at Deakin University has published a series of guides on Gen AI in work-integrated learning.

The resources are for Higher Education/University staff, students and workplace industry partners. There are four sets of guides:

- for ensuring academic integrity and assessment security with online delivery

- assessing work-integrated learning programmes - a guide to effective assessment design

- inclusive assessments

- reimaging exams - workshop resources.

All in there are good recommendations. Although pitched at the higher education sector, the work-integrated and inclusive assessment sections are easily generalisable to other contexts.



Thursday, March 20, 2025

Webinar notes - Trade Routes: Charting new pathways from secondary school to industry

 Attended the webinar organised by the NZ Initiative. 

The event provides an overview of a report on 'Trade routes: charting new pathways from school to industry training'. 

The webinar's description - Drawing inspiration from Germany's successful dual-training model, Josh Williams and Dr Michael Johnston will discuss initiatives in secondary and tertiary education to enhance the status and quality of trades and industry training.

Notes taken:

Oliver Hartwich provided overview, introductions to Dr. Michael Johnston and Josh Williams and chaired the webinar.

Sli.do hosts the Q & A -

Observed that 65,000 Students leave school each year and about 1/3 go to university. Only 6% take up apprenticeship and 7% are NEETs (sigh).

Cultural aspects in NZ mean most take the university as there is lack of visibility of alternatives and much lower esteem for trades work.

Education is not cohesive. The pathways from work into alternatives to university are not easy. Vocational pathways need to attain parity of esteem with higher education. Proposed several ways to bring this to fruition.

It will take time but there is a need to start the pathway at school, rather than post school.

For apprentices, starting on lower pay and moving to full pay will encourage employers to take on apprentices. A bonding system may be useful for apprentices to stay a few years with employer, post completion of the apprenticeship contract.

Also suggested the fee free for degree students be diverted to apprenticeships, which will cover most of the training costs for the 6% of school leavers moving into apprenticeship.

Work Development Councils need to be given wider scope. Instead of appointment by government, they should be appointed by industry and not only be responsible for standards setting but also approval for programmes/ and supporting providers (secondary schools) to set up themselves.

Need to be a progression from school on to tertiary / apprenticeship rather than a abrupt shift.

Josh contributed the Forward for the report. Important to not just 'drag and drop' the German dual system across but to think through the things that will work for us in Aotearoa.

Provided a background on how a decade ago, Youth Pathways was launched, along with Arthur Graves. There are initiatives - STAR, Gateway etc. but they not always well coordinated. Specialising at high school may be difficult later on, but they provide a good start.

Provided some examples of schools that are doing good work in this area. Important that all the ones who are successful have good connections and networks with their local communities, employers and industries.

The ecosystem to support change in this area needs to be undertaken but requires multiple connections and a holistic understanding to work out what will work.

Q & A ensured of the 30+ questions collected on sli.do.

Interesting presentation and some recommendations make good sense. Had to leave to be at another meeting so missed the bulk of the Q & A.



Monday, March 17, 2025

AI in education: The intersection of pedagogy and technology

 This book published 2024 by Springer is edited by P. Ilic, I. Casbourne and R. Wegerif.

It is an open access book which brings together educators, engineers and experts to explore the implications and affordances provisioned through the arrival of Generative Artificial Intelligence (Gen AI).

There are 13 chapters, detailing studies in the higher education context.

The first introductory chapter, by the editors, calls for 'a constructive dialogue' between technology and pedagogy. In doing, the two may contribute more towards enhancing human potential. 

Following on, an interesting selection of chapters:

- AI enhanced ecological learning spaces by P. Ilic, and M. Sato-Ilic.

- reimagining learning experiences with the use of AI with D. Guralnick

- Gen AI integration in education: challenges and approaches by S. Watson and S. Shi.

- Navigating AI in education - towards a system approach for design of educational changes by L. Yuan, T. Hoel, and S. Powell.

-AI in the assessment ecosystem: A human-centered AI perspective by A. A. von Davier and J. Burnstein.

- The role of AI language assistants in dialogic education for collective intelligence by I. Casebourne and R. Wegerif.

- AI powered adaptive formative assessment: validity and reliability evaluation by Y. Bimpeh.

- Decimal point: a decade of learning science findings with a digital learning game with B. M. McLaren.

- Leveraging AI to advance science and computing education across Africa: challenges, progress and opportunities with G. Boateng

- Educating manufacturing operators by extending reality with AI by  P-D. Zuercher, M. Schimpf, S. Tadeja and T. Bohne.


- Pedagogical restructuring of business communication courses: AI-enhanced prompt engineering in an EFL teaching context by D. Roy.

- AI in language education: The impact of machine translation and ChatGPT by L. Ohashi.


Overall a good collection of case studies, providing some good examples of integrating AI into specific disciplines. The discussions are congruent to our current work, in that although Gen AI is a tool for all, there is still a need to match Gen tools to the learning outcomes to be achieved. Most importantly to maintain the human element and contribution towards AI responses and to remember that AI is a tool and it is the tool user who much always take responsibility for the outputs. 


Monday, March 10, 2025

AI NZ AI blueprint

 The AI forum in New Zealand - has published a blueprint for charting NZ's AI powered future. 

It is a follow up from a blueprint published in 2024. The blueprint is a high level strategic document providing rationale and recommendations.

The main items are:

- supporting and encouraging adoption of an AI strategy for Aotearoa by government

- making good governance possible for responsible, accessible and affordable AI for all.

- Encouraging upskills across the existing workforce.

- providing Māori with voice and guidance for the intersection of Te Tiriti, Te Ao Māori and AI.

- telling stories that bring life to how AI is used across Aotearoa.

The blueprint then shares the frameworks , recommendations and guidelines to action the main items. 



Monday, March 03, 2025

Developing curriculum for deep learning - overview of open access Springer brief

 In tandem with the recent blogs with overviews of recent scholarly books on embodiment and being and becoming through higher education, this book 'developing curriculum for deep learning: the knowledge revival' brings a school-based context. 

The book is open access and written by a range of authors from Europe (T, More - Belgium; N. Crato, Portugal, D. Muijs, UK; D. Wiliam, UK; P.A. Kirschner, Netherlands), Australia (J. Hattie) and New Zealand (E. Rata), many with scholarly contributions to the educational literature across many years. 

There are five chapters, beginning with a summary and ending with a chapter of concluding remarks.

The second chapter argues for the need to ensure that the pursuit of knowledge is not left out in a curriculum crowded with many needs. The third chapter sets out the relationships between knowledge and the school curriculum. The fourth chapter has concluding remarks to close the argument.

The last executive summary lays out the reasons knowledge matters from the perspectives of learning (developing our minds as humans); sociology (knowledge contribution to society); democracy (to bring about better lives for all). The importance of the curriculum in ensuring knowledge is included is then discussed with the need to establish a knowledge rich curriculum through the school years. 

Overall, good background on the aspect of knowledge in education. Its importance, role in learner's formative years, contribution to societal function. and the future of the human race.