kirkpatrick's four levels of training evaluation柯克評價四個層次培訓
This grid illustrates the basic Kirkpatrick structure at a glance.這說明網格的基本結構柯克帕特里克一瞥.The second grid, beneath this one, is the same thing with more detail.二格,底下這一塊是一回事更多細節(jié).
level級別 |
evaluation type (what is measured)評價型(什么是衡量) |
evaluation description and characteristics描述和評價特點 |
examples of evaluation tools and methods評估工具和方法范例 |
relevance and practicability相關性和實用性 |
1 一月 |
reaction反應 |
- reaction evaluationis how the delegates felt about the training or learning experience與會的反應是如何評價訓練或學習經驗的感受
|
- eg., 'happy sheets', feedback forms例如.'快樂片',反饋表
- also verbal reaction, post-training surveys or questionnaires還口頭反應、培訓后的問卷調查,還是
|
- quick and very easy to obtain很容易得到快速
- not expensive to gather or to analyse不算貴搜集或分析
|
2 二月 |
learning學習 |
- learning evaluationis the measurement of the increase in knowledge - before and after學習評價是衡量增長知識前后
|
- typically assessments or tests before and after the training一般評估或測試訓練前后
- interview or observation can also be used也可以采用訪談或觀察
|
- relatively simple to set up; clear-cut for quantifiable skills相對簡單設置;鮮明的量化技巧
- less easy for complex learning不容易學習復雜
|
3 三月 |
behaviour行為 |
- behaviour evaluationis the extent of applied learning back on the job - implementation行為評價是應用程度的學習回到工作落實
|
- observation and interview over time are required to assess change, relevance of change, and sustainability of change觀察與評估面試時間須改變,相關變革和可持續(xù)性轉變
|
- measurement of behaviour change typically requires cooperation and skill of line-managers計量行為改變通常需要合作和技術線經理
|
4 四月 |
results 結果 |
- results evaluationis the effect on the business or environment by the trainee結果評價是對學員的經商環(huán)境
|
- measures are already in place via normal management systems and reporting - the challenge is to relate to the trainee通過正常的措施已經到位的管理制度和報告-面臨的挑戰(zhàn)是關系到實習生
|
- individually not difficult; unlike whole organisation個別并不困難;不像整個組織
- process must attributing clear accountabilities要明確責任歸咎于進程
|
kirkpatrick's four levels of training evaluation in detail柯克詳細評價四個層次培訓
This grid illustrates the Kirkpatrick's structure detail, and particularly the modern-day interpretation of the Kirkpatrick learning evaluation model, usage, implications, and examples of tools and methods.這說明電網柯克結構細節(jié),尤其現代詮釋柯克帕特里克學習評價模型,用法含義及實例工具和方法.This diagram is the same format as the one above but with more detail and explanation:這是圖一以上為相同的格式更詳細的解釋,但:
level級別 |
evaluation type (what is measured)評價型(什么是衡量) |
evaluation description and characteristics描述和評價特點 |
examples of evaluation tools and methods評估工具和方法范例 |
relevance and practicability相關性和實用性 |
1 一月 |
reaction反應 |
- reaction evaluationis how the delegates felt , and their personal reactions to the training or learning experience , for example:與會代表認為是如何評價反應、個人反應訓練或學習經驗,例如:
- did the trainees like and enjoy the training?當時學員訓練一樣,享受?
- did they consider the training relevant?何曾考慮相關培訓?
- was it a good use of their time?它是利用好自己的時間?
- did they like the venue, the style, timing, domestics, etc?他們喜歡的場地,風格、時機、女傭等?
- level of participation參與程度
- ease and comfort of experience安逸經驗
- level of effort required to make the most of the learning一級必須作出最大努力的學習
- perceived practicability and potential for applying the learning自覺學習的實用性和應用潛力
|
- typically 'happy sheets'典型的快樂片'
- feedback forms based on subjective personal reaction to the training experience基于個人主觀形式反饋反應訓練的經驗
- verbal reaction which can be noted and analysed言語反應可說和分析
- post-training surveys or questionnaires培訓后的問卷調查,還是
- online evaluation or grading by delegates在線等級評價或代表
- subsequent verbal or written reports given by delegates to managers back at their jobs隨后口頭或書面報告,獲得與會經理人的飯碗回
|
- can be done immediately the training ends馬上可以做的訓練結束
- very easy to obtain reaction feedback很容易得到反饋反應
- feedback is not expensive to gather or to analyse for groups收集反饋并不昂貴或群體分析
- important to know that people were not upset or disappointed沒有人知道重要底價或失望
- important that people give a positive impression when relating their experience to others who might be deciding whether to experience same重要的是,人們的印象是正面的經驗,當他們與其他人可能決定是否經驗同一
|
2 二月 |
learning學習 |
- learning evaluationis the measurement of the increase in knowledge or intellectual capability from before to after the learning experience:學習評價是衡量增加知識或智力能力的學習經驗,從以前到以后:
- did the trainees learn what what intended to be taught?學員學習什么打算做什么來教導?
- did the trainee experience what was intended for them to experience?當時學員經驗讓他們體驗什么打算?
- what is the extent of advancement or change in the trainees after the training, in the direction or area that was intended?什么程度提高或改變學員經培訓、該方向或地區(qū)的用意?
|
- typically assessments or tests before and after the training一般評估或測試訓練前后
- interview or observation can be used before and after although this is time-consuming and can be inconsistent面試或可用于觀測雖然是前后費時可以不一致
- methods of assessment need to be closely related to the aims of the learning評估方式需要加以密切相關的學習目標
- measurement and analysis is possible and easy on a group scale測量和分析可能容易一批規(guī)模
- reliable, clear scoring and measurements need to be established, so as to limit the risk of inconsistent assessment可靠、清晰、測量得分需要建立,借以限制風險評估不一致
- hard-copy, electronic, online or interview style assessments are all possible硬拷貝、電子、風評都在網上或播出訪談
|
- relatively simple to set up, but more investment and thought required than reaction evaluation設置相對簡單,但更需要思考和投資比反應評價
- highly relevant and clear-cut for certain training such as quantifiable or technical skills很強的針對性和鮮明的某些技術技能培訓等量化或
- less easy for more complex learning such as attitudinal development, which is famously difficult to assess不容易學等較為復雜的態(tài)度,即以言詞難以評估
- cost escalates if systems are poorly designed, which increases work required to measure and analyse如果制度設計不當成本升高,增加工作必須測量和分析
|
3 三月 |
behaviour行為 |
- behaviour evaluationis the extent to which the trainees applied the learning and changed their behaviour , and this can be immediately and several months after the training, depending on the situation:在多大程度上是行為評價學員的學習和運用改變自己的行為,這可以立刻和幾個月的訓練后,視情況:
- did the trainees put their learning into effect when back on the job?當時學員學以致用賽前當回事?
- were the relevant skills and knowledge used有相關的技術和知識用于
- was there noticeable and measurable change in the activity and performance of the trainees when back in their roles?有明顯變化的活動,并衡量學員表現在民國演什么角色?
- was the change in behaviour and new level of knowledge sustained?為行為改變、新的知識水平持續(xù)?
- would the trainee be able to transfer their learning to another person?學員將學習才能轉讓給他人?
- is the trainee aware of their change in behaviour, knowledge, skill level?學員認識到自己是行為的改變、知識、技能水平?
|
- observation and interview over time are required to assess change, relevance of change, and sustainability of change觀察與評估面試時間須改變,相關變革和可持續(xù)性轉變
- arbitrary snapshot assessments are not reliable because people change in different ways at different times快照任意變動評估不可靠,因為人們以不同的方式在不同時期
- assessments need to be subtle and ongoing, and then transferred to a suitable analysis tool須含蓄而正在進行評估,然后再轉到合適的分析工具
- assessments need to be designed to reduce subjective judgement of the observer or interviewer, which is a variable factor that can affect reliability and consistency of measurements須評估旨在減少主觀判斷或觀察員訪談這是一個可以影響可變因素可靠性和一致性測量
- the opinion of the trainee, which is a relevant indicator, is also subjective and unreliable, and so needs to be measured in a consistent defined way學員認為,這是一個有關指標,也是主觀和可靠,所以需要加以衡量的一貫方式界定
- 360-degree feedback is useful method and need not be used before training, because respondents can make a judgement as to change after training, and this can be analysed for groups of respondents and trainees360度反饋是必要和有益的方法,不得使用前訓練、因為受訪者能作判斷,改變后的培訓,這可以分析受訪群體及學員
- assessments can be designed around relevant performance scenarios, and specific key performance indicators or criteria圍繞相關的評估可以設計表現了2016年和具體指標或標準
- online and electronic assessments are more difficult to incorporate - assessments tend to be more successful when integrated within existing management and coaching protocols網上電子評估將更難-評估時往往是比較成功的現有綜合管理和教練議定書
- self-assessment can be useful, using carefully designed criteria and measurements自我評估可以非常有用,使用精心設計的標準和測量
|
- measurement of behaviour change is less easy to quantify and interpret than reaction and learning evaluation計量行為改變是難以量化評價、解釋和學習過的反應
- simple quick response systems unlikely to be adequate簡單快速反應系統(tǒng)未必有充分
- cooperation and skill of observers, typically line-managers, are important factors, and difficult to control觀察家合作和技巧,通常線經理,都是重要因素,而難以控制
- management and analysis of ongoing subtle assessments are difficult, and virtually impossible without a well-designed system from the beginning管理與評估分析正在進行微妙難,幾乎不可能在沒有良好的制度設計,從一開始
- evaluation of implementation and application is an extremely important assessment - there is little point in a good reaction and good increase in capability if nothing changes back in the job, therefore evaluation in this area is vital, albeit challenging實施評價和應用,是一個極為重要的評估點毫無反應良好如果沒有良好的增長能力,改變回來工作,所以在這方面的評價是至關重要的,盡管挑戰(zhàn)
- behaviour change evaluation is possible given good support and involvement from line managers or trainees, so it is helpful to involve them from the start, and to identify benefits for them, which links to the level 4 evaluation below行為改變可能給予很好的評價是由各級管理人員的支持和參與或受訓這樣有利于讓他們從一開始,并確定他們的福利,連接到4級以下的評價
|
4 四月 |
results 結果 |
- results evaluationis the effect on the business or environment resulting from the improved performance of the trainee - it is the acid test結果評價是對經商環(huán)境因表現改善學員-這是一個嚴峻的考驗
- measures would typically be business or organisational key performance indicators, such as:通常企業(yè)或組織措施主要性能指標,如:
- volumes, values, percentages, timescales, return on investment, and other quantifiable aspects of organisational performance, for instance; numbers of complaints, staff turnover, attrition, failures, wastage, non-compliance, quality ratings, achievement of standards and accreditations, growth, retention, etc.冊,價值,比率,時間尺度,投資回報和其他組織可以量化方面的表現,例如;號碼申訴,員工流動率、減員、失敗、流失、不符合質量等級、標準和認證實現增長,保存等
|
- it is possible that many of these measures are already in place via normal management systems and reporting它可能是許多這些措施已經到位通過正常管理制度和報告
- the challenge is to identify which and how relate to to the trainee's input and influence目前的挑戰(zhàn)是,如何找出其中涉及到學員的投入和影響
- therefore it is important to identify and agree accountability and relevance with the trainee at the start of the training, so they understand what is to be measured因此,我們必須找出并同意責任制和相關的培訓學員在開始,所以要了解什么是測量
- this process overlays normal good management practice - it simply needs linking to the training input這個過程正常重疊好的管理方式,它只是需要連接到訓練投入
- failure to link to training input type and timing will greatly reduce the ease by which results can be attributed to the training不連接型、投入訓練的時間將大大減少,減輕了成績歸結到訓練
- for senior people particularly, annual appraisals and ongoing agreement of key business objectives are integral to measuring business results derived from training資深人士尤其年度考核和持續(xù)經營的目標是一致的關鍵業(yè)績所得積分來衡量訓練
|
- individually, results evaluation is not particularly difficult; across an entire organisation it becomes very much more challenging, not least because of the reliance on line-management, and the frequency and scale of changing structures, responsibilities and roles, which complicates the process of attributing clear accountability個體、評價結果并不是特別困難;橫跨整個組織變得更為嚴峻不僅僅是因為依賴線管理、頻率、規(guī)模結構轉變、職責和作用,而復雜的過程交代清楚分數
- also, external factors greatly affect organisational and business performance, which cloud the true cause of good or poor results同時,外部因素影響極大的組織和經營成果,真正原因云好壞結果
|
Since Kirkpatrick established his original model, other theorists (for example Jack Phillips), and indeed Kirkpatrick himself, have referred to a possible fifth level, namely ROI (Return On Investment).柯克帕特里克成立以來原模型,其他理論家(例如杰克菲利普斯)、柯克帕特里克確實自己提到可能第五級,即音(投資回報).In my view ROI can easily be included in Kirkpatrick's original fourth level 'Results'.在我看來,容易被列入感興趣柯克原第四級'的結果.The inclusion and relevance of a fifth level is therefore arguably only relevant if the assessment of Return On Investment might otherwise be ignored or forgotten when referring simply to the 'Results' level.列入第五級和相關性,因此若說只有相關的評估投資回報否則可能被忽視或遺忘時指純粹'結果'的水平.
Learning evaluation is a widely researched area.學習評價是一種廣泛研究領域.This is understandable since the subject is fundamental to the existence and performance of education around the world, not least universities, which of course contain most of the researchers and writers.這是可以理解的,因為這個問題是根本的生存和教育表現全世界同樣的大學,其中當然大部分的研究者和作家.
While Kirkpatrick's model is not the only one of its type, for most industrial and commercial applications it suffices; indeed most organisations would be absolutely thrilled if their training and learning evaluation, and thereby their ongoing people-development, were planned and managed according to Kirkpatrick's model.而柯克模式不是唯一的方式,大多數工業(yè)和商業(yè)應用它足以;事實上,如果多數團體將是十分興奮的培訓和學習的評價,從而不斷人為開發(fā)經過規(guī)劃和管理,依照柯克帕特里克的模型.
For reference, should you be keen to look at more ideas, there are many to choose from...供參考,如果你渴望更多的想法來看,還有很多選擇::
- Jack Phillips' Five Level ROI Model杰克菲利普斯'五個層次模型感興趣
- Daniel Stufflebeam's CIPP Model (Context, Input, Process, Product)丹尼爾敎的CIPP模式(背景、輸入、過程、產品)
- Robert Stake's Responsive Evaluation Model羅伯特股權的回應評價模型
- Robert Stake's Congruence-Contingency Model羅伯特股權的余應變模式
- Kaufman's Five Levels of Evaluation考夫曼的五個層次評價
- CIRO (Context, Input, Reaction, Outcome)仙樂(背景、輸入、反應、結果)
- PERT (Program Evaluation and Review Technique)PERT(計劃評審技術)
- Alkins' UCLA Modelalkins'示范分校
- Michael Scriven's Goal-Free Evaluation Approach邁克爾scriven的目標--自由評價辦法
- Provus's Discrepancy Modelprovus的差異模型
- Eisner's Connoisseurship Evaluation Models艾斯納的鑒賞評價模式
- Illuminative Evaluation Model照明評估模型
- Portraiture Model肖像模型
- and also the American Evaluation Association美國評估協(xié)會也
Also look at
Leslie Rae's excellent Training Evaluation and toolsavailable on this site, which, given Leslie's experience and knowledge, will save you the job of researching and designing your own tools.
萊斯利還看評審的評價和良好的訓練工具,這個網站瀏覽,其中萊斯利獲得的經驗和知識,將會節(jié)省您的工作,研究和設計自己的工具.
evaluation of HRD function performance人力資源功能績效評價
If you are responsible for HR functions and services to internal and/or external customers, you might find it useful to go beyond Kirkpatrick's evaluation of
training and learning , and to evaluate also
satisfaction among staff/customers with HR department's overall performance .如果你是負責內部人力資源和服務功能和/或外部客戶
你可能會覺得有用超越柯克評價培訓和學習,提高員工的滿意評價也/客戶提供人力部的整體表現.The parameters for such an evaluation ultimately depend on what your HR function is responsible for - in other words, evaluate according to expectations.參數這種評價最終要靠你們什么功能是負責人力資源--換言之,據評估期望.
Like anything else, evaluating customer satisfaction must first begin with a clear appreciation of (internal) customers' expectations.喜歡什么,首先必須先評估客戶滿意升值(內部)明確顧客的期望.Expectations - agreed, stated, published or otherwise - provide the basis for evaluating all types of customer satisfaction.期望商定,題,刊登與否提供依據各類客戶滿意的評價.
If people have expectations which go beyond HR department's stated and actual responsibilities, then the matter must be pursued because it will almost certainly offer an opportunity to add value to HR's activities, and to add value and competitive advantage to your organisation as a whole.如果人們期望超越人力部的聲明和實際責任那么要追查因為幾乎肯定會提供機會增值小時的活動中,價值和競爭優(yōu)勢,加上貴組織作為一個整體.In this fast changing world, HR is increasingly the department which is most likely to see and respond to new opportunities for the support and development of the your people - so respond, understand, and do what you can to meet new demands when you see them.在這個瞬息萬變越來越多的人力資源處最容易看到和應對新的機遇和支持你們開發(fā)的人怎么回應,理解,你可以做什么,以滿足新的需求,當你看到他們.
If you are keen to know how well HR department is meeting people's expectations, a questionnaire, and/or some group discussions will shed light on the situation.如果你渴望知道人力部會的預期,一份問卷,和/或分組討論會揭示一些情況.
Here are some example questions.以下是一些例子提問.Effectively you should be asking people to say how well HR or
HRD department has done the following:有效地說,你應該要求人們如何做人力資源或人力資源處:
- helped me to identify , understand , identify and prioritise my personal development needs and wishes , in terms of: skills , knowledge , experience and attitude (or personal well-being, or emotional maturity, or mood, or mind-set, or any other suitable term meaning mental approach, which people will respond to)幫我查明,認識,識別和優(yōu)先發(fā)展的需要和個人意愿,在:技能、知識、經驗和態(tài)度(或個人福祉,或情緒成熟度,或者心情,或者心態(tài),精神病或其他適當方式意義而言,人們會回應)
- helped me to understand my own preferred learning style and learning methods for acquiring new skills , knowledge and attitudinal capabilities幫助我了解自己喜歡的學習風格和學習方法學習新技能、知識和態(tài)度能力
- helped me to identify and obtain effective learning and development that suits my preferred style and circumstances幫我找出有效的學習和發(fā)展,并取得適合我國情況和首選風格
- helped me to measure my development , and for the measurement to be clear to my boss and others in the organisation who should know about my capabilities幫我發(fā)展,我來衡量,要明確和計量等我老板來了誰知道我的組織能力
- provided tools and systems to encourage and facilitate my personal development提供工具和體系,鼓勵和促進個人發(fā)展
- and particularly helped to optimise the relationship between me and my boss relating to assisting my own personal development and well-being尤其是有助于更好的關系,我和我的老板關于協(xié)助我個人的發(fā)展和福祉
- provided a working environment that protects me from discrimination and harassment of any sort我提供了一個工作環(huán)境,保護任何種類的歧視和性騷擾
- provided the opportunity for me to voice my grievances if I have any, (in private, to a suitably trained person in the company whom I trust) and then if I so wish for proper consideration and response to be given to them by the company只要讓我有機會,如果我有任何不滿,(私下受過適當訓練的人員來我公司信任),然后想如果我做適當的考慮并給他們的回答是該公司
- provided the opportunity for me to receive counselling and advice in the event that I need private and supportive help of this type, again from a suitably trained person in the company whom I trust我提供了機會,接受輔導和咨詢活動,我需要幫助和支持民營這類,再從受過適當訓練的人,我相信該公司
- ensured that disciplinary processes are clear and fair, and include the right of appeal確保懲戒程序清晰、公平、包括訴權
- ensured that recruitment and promotion of staff are managed fairly and transparently確保招聘管理人員和促進公正和透明
- ensuring that systems and activities exist to keep all staff informed of company plans, performance, etc., (as normally included in a Team Briefing system)確保系統(tǒng)存在和活動的所有工作人員隨時了解公司的計劃,演出等(通常在一隊通報制度)
- (if you dare...) ensuring that people are paid and rewarded fairly in relation to other company employees, and separately, paid and rewarded fairly when compared to market norms (your CEO will not like this question, but if you have a problem in this area it's best to know about it...)(如果你敢:)確保人們付出相當的報酬,并與其它公司雇員,另外,薪和獎勵規(guī)范市場頗為相比(總裁不會喜歡你這個問題,但如果你有這方面的問題也最好知道::)
- (and for managers ) helped me to ensure the development needs of my staff are identified and supported(經理)幫我發(fā)展的需要,保證和支持我的工作人員發(fā)現
This is not an exhaustive list - just some examples.這不是無遺--只是一些例子.Many of the examples contain elements which should under typical large company circumstances be broken down to create more and smaller questions about more specific aspects of HR support and services.許多的典型事例含有一些大公司的情況下,應該可以創(chuàng)造更多、破裂小問更具體的支持和人力資源方面的服務.
If you work in HR, or run an HR department, and consider that some of these issues and expectations fall outside your remit, then consider who else is responsible for them.如果你在人力資源工作,或者開辦了人力資源處并認為其中一些問題和期待屬于你職權然后考慮誰應該負責.
I repeat, in this fast changing world, HR is increasingly the department which is most likely to see and respond to new opportunities for the support and development of the your people - so respond, understand, and do what you can to meet new demands when you see them.我再說一次,在這個瞬息萬變越來越多的人力資源處最容易看到和應對新的機遇和支持你們開發(fā)的人怎么回應,理解,你可以做什么,以滿足新的需求,當你看到他們.In doing so you will add value to your people and your organisation - and your department.這樣你會增值你和你的人民團體和貴處.