ISEN-ASTC-L is a service of the Association of Science-Technology Centers
Incorporated, a worldwide network of science museums and related institutions.
*****************************************************************************

Charlie,

I'm not sure how museum related STEM learning in museums will be measured.  I've met enough evaluators and researchers to be convinced that there is not full agreement on how informal learning should be measured.  Some people like the idea that a single fact is remembered, while others reject that notion, and say we should be measuring questioning or observation skills at exhibits.  Perhaps this is as much a function of what the museum sets as its goals.

I did find one thing odd in your comments:  the idea that the Exploratorium would be an accredited educational institution.  Has that ever been sought after?  If so I would be surprised.  I know of the related CILS project, but that was in conjunction with universities.  

-William




On Jun 5, 2013, at 4:44 PM, Charles Carlson wrote:

> ISEN-ASTC-L is a service of the Association of Science-Technology Centers
> Incorporated, a worldwide network of science museums and related institutions.
> *****************************************************************************
> 
> Hi William,
> 
> I agree with doing program assessment.  I fundamentally disagree with the notion that assessable STEM content is going to be taught via museums in a consistently measurable way.  Given the unique backgrounds of visitors, their extremely short time durations––whether it's 10 seconds or two hours, it's still very short––the meaningful retention of a novel or useful strategy for critical thinking, or even individual bits of information––is scant, unless someone is highly motivated and is able to scaffold, or has scaffolded the strategies and knowledge from prior experiences.  
> 
> The brain's learning capabilities, human social behavior and affects of the family and classroom environments point towards extended multiple experiences as key.  No one fails a museum, and no one passes one either.  That said, the STEM threshold bar needs to start very low and expand upward to the highest levels, and it needs to be accurate in its representation.  It also needs to embrace a wide range of topics, and inspire people.  Looking for specific measurable effects of testable STEM learning in the museum setting is not a useful expenditure of resources and misses the point of museums.  They are not classrooms.  They are forests and jungles of scientific stuff re-interpreted and displayed.
> 
> They should be evaluated for scientific accuracy and consistency by scientists in the field.  Exactly, how museums succeed in attracting visitors should be defined by the museums themselves and proven by their social worthiness to the community.  There's almost no predictable track record of what will succeed and what won't.  
> 
> The Exploratorium started against all odds.  No one thought Frank and Jackie were going to succeed.  Museums at the time did not consider the Exploratorium a museum or worthy of institutional status, and we're still not reognized as an accredited educational institution.   It was a maverick, odd ball of a place in an odd ball building.  It worked because people came and enjoyed the experience, from kindergardeners to Nobel Laureates.  No one knows what people learned, and it was never sold as a way to change the world or revolutionize classroom education.  It was sold as a provocatively, fun, human activity that involved intellect and emotion.  
> 
> The Monterey Bay Aquarium is another institutional example.  The city of Monterey fought tooth and nail to keep an aquarium out of town.  They refused to build any parking for it, and it took lots of dedication, an unemployed marine biologist, supportive family, and tons of money to get it going.  The rest is history, and a goodly part of Monterey's economic livelihood hinges on it.
> 
> The same might be said of Maker Fairs and Burning Man.
> 
> 
> C
> On Jun 5, 2013, at 1:21 PM, William Katzman <[log in to unmask]> wrote:
> 
>> ISEN-ASTC-L is a service of the Association of Science-Technology Centers
>> Incorporated, a worldwide network of science museums and related institutions.
>> *****************************************************************************
>> 
>> Charlie,
>> 
>> I understand where you are coming from, but they actually have not eliminated funding for all STEM museum projects outside of the Smithsonian, which was my first reaction to reading the news months ago.   
>> What they have done is reorganized the governmental programs.  Instead of allowing every governmental agency to fund STEM programs, only a select few can with an emphasis on accountability.  Yes, the era of  evaluation is upon us!  I doubt that will ever go away.  In a sense it has always been there:  every time a person walks through your museum's doors, that visitor is evaluating your efforts - it's just less of a formal evaluation.  
>> 
>> Remember:  IMLS and NSF's AISL programs still exist.  The ones that had the most revamping seem to be agencies like NASA and Dept. of Energy, who really did seem to get their EPO efforts taken away and given to the Smithsonian.  If this proposal proceeds it will likely remove a number of good programs (the Smithsonian could conceivably keep the programs working though).  It will also likely remove a number of programs that although well intentioned may not have been conducted with enough expertise (how hard could it be to do science outreach - give it to the grad student/intern/etc). 
>> 
>> -William "not speaking for my institution" Katzman
>> 
>> 
>> 
>> On Jun 5, 2013, at 2:38 PM, Charles Carlson wrote:
>> 
>>> ISEN-ASTC-L is a service of the Association of Science-Technology Centers
>>> Incorporated, a worldwide network of science museums and related institutions.
>>> *****************************************************************************
>>> 
>>> Martin,
>>> Thanks for posting!  Re-reading this plan for the umpteenth time, it feels to me like the only museum that counts is the Smithsonian and the only STEM affects that need be considered are ones measurable in the classroom.  The vast majority of museums and informal science activities fall outside of those narrow parameters, and embrace a much wider, self-identified engagement and interest in science, math, engineering and technology.   It's a shameful oversight, pennywise and pound foolish.
>>> 
>>> It makes me sad and angry!
>>> C
>>> 
> 
> The opinions and thoughts expressed here are my own and should in no way be construed or attributed to the Exploratorium or related organization, and do not represent an institutional position.  
> 
> Virus Notice:  Neither I nor any of my agents accept any responsibility for any viruses that may be contained in this email or any attachments, and it is your responsibility to scan the email and any attachments.
> Charles Carlson
> http://blogs.exploratorium.edu/whyintercept/
> Twitter: @charliec53
> email: [log in to unmask] 
> Tel:   415-528-4319
> Fax:  415-885-6011
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> 
> ***********************************************************************
> For information about the Association of Science-Technology Centers and the Informal Science Education Network please visit www.astc.org.
> 
> Check out the latest case studies and reviews on ExhibitFiles at www.exhibitfiles.org.
> 
> The ISEN-ASTC-L email list is powered by LISTSERVR software from L-Soft. To learn more, visit
> http://www.lsoft.com/LISTSERV-powered.html.
> 
> To remove your e-mail address from the ISEN-ASTC-L list, send the
> message  SIGNOFF ISEN-ASTC-L in the BODY of a message to
> [log in to unmask]

***********************************************************************
For information about the Association of Science-Technology Centers and the Informal Science Education Network please visit www.astc.org.

Check out the latest case studies and reviews on ExhibitFiles at www.exhibitfiles.org.

The ISEN-ASTC-L email list is powered by LISTSERVR software from L-Soft. To learn more, visit
http://www.lsoft.com/LISTSERV-powered.html.

To remove your e-mail address from the ISEN-ASTC-L list, send the
message  SIGNOFF ISEN-ASTC-L in the BODY of a message to
[log in to unmask]