I just can't with dumb and inequitable RFQ/RFP processes anymore. Y'all are making choices and showing your real values.

If you don't include a budget, don't lie to me about your (organizational?) reasons. Just say that a) you have a person in mind and you need a third proposal or b) your organization is knowingly choosing to support White supremacy culture and business as usual. It'll save everyone time.

#evaluation #rfq #rfp #DoBetter #EquitableEvaluation

Visitor Studies Association conference site: https://visitorstudies.org/2023-annual-conference

Session info (July 12 2:15-3:15pm EST) is in the image with alt text, but I'm happy to give more info if folks would like!

In sharing my part, I hope that we can discern something closer to the truth(s) we're experiencing and find some ways forward. Lord knows that isn't happening with folks silenced or staying quiet...or polite.

#evaluation #accountability #EquitableEvaluation #RealEvalTalk #spicy

Alongside groups Native Pathways and Reimagine Research, I'm getting ready to truly start on a project that investigates how to support Native American Knowledge in STEM contexts with the Smithsonian NMAI.

This should be amazing and a wonderful application of my equitable evaluation principles and the Equitable Evaluation Framework from EEI.

Rewarding and challenging in all the ways that make this work worthwhile!

#evaluation #EquitableEvaluation #STEM #NativeKnowledge

Just a general note:

If you appreciate and are using the labor and IP of a consultant who was central to the work you're being interviewed about - maybe cite them? Say their name(s).

Especially if that consultant is looking for work. After there was suddenly no budget room.

Like me. The evaluator that did the evaluation and a ton of the organizational equity work their praising is me.

https://www.youtube.com/watch?v=qsPXs7xEzUQ&t=35s

#evaluation #EquitableEvaluation #RealEvalTalk

@emilymbender @alex

More evaluators should be in this struggle against "mathy maths," SALAMIs, and "AIs." I guess that only matters if they are truly interested in practicing equity and promoting restorative justice.

I'm just tired of researching and hearing those phrases as performance.

#EquitableEvaluation #RealEvalTalk #evaluation #LLM

LB: Listened again after several frustrating conversations about LLMs in evaluation. I don't know when we'll reach critical mass in the number of folks calling bullshit on the hype and misanthropic interactions these folks are pushing.

I can only hope we sense that progress soon.

#evaluation #EquitableEvaluation #LLM #FreshHell #RealEvalTalk

H/t @emilymbender @alex

Hello out there! I'm still looking for projects/work in research and evaluation. I'd appreciate any leads or ideas for possible partners that are interested in equitable evaluation and research, especially with work involving cultures, arts, and science.

Some quick info about me here: https://glammr.us/@steamworkgroup/109309876937717818 and at https://steamworkgroup.com

Thanks for any boosts and for consideration!

#EquitableEvaluation #equity #project #research #evaluation #consulting

I'm not the first to say this kind of thing, but I might have been the first to say it at this organization where I had been invited as a discussant.

I don't think folks were ready for that type of introspection (maybe I'm wrong).

So my question to y'all is, how can we encourage people along those lines, towards organizational change at this foundational level?

Because of the continuing harm, it's time for action.

#EquitableEvaluation #evaluation #RealEvalTalk #OrganizationalChange

Because I am seriously done with half measures (theoretically, evaluatively, and practically), I brought up in a meeting the idea that being an ally isn't an endpoint. If we're serious about anti-racism, equitable evaluation, and liberation, we should think of ourselves as advocates, collaborators, and agitators. Allies, after all, can be seen as a political role that comes and goes. If I'm a collaborator, I'm committed to take the risk with folks.

#EquitableEvaluation #evaluation #RealEvalTalk

Over the last three-four years, I've seen so many more trackers (pixels, cookies, API calls, and other identifiers) in so called "anonymous surveys." Nevermind the triangulation questions. I've had to all but yell at other companies - all of which should know better - to attempt stop this nonsense. Most of the time, I get a pat on the head and told not to worry.

#data #privacy #evaluation #EquitableEvaluation

Museum Evaluators - when it comes to difficult and challenging exhibitions for your context, do you have a general guideline for how effective we should be in facilitating outcome achievement for visitors?

What percentage of visitors counts as success?

The outcomes are measured qualitatively by rubric and Likert scales via interview.

(Yes yes... I know it depends... But also, you have an idea, I'm guessing!)

#Evaluation #EquitableEvaluation #ExhibtionsWorthDoing

Getting ready to finish draft and presentation of a summative for an IMLS project on a project that's very connected to my values and, more importantly, important to Native American communities.

I'm feeling a lot of pressure and apprehension, even though I've put #EquitableEvaluation into everything I could. It's miles ahead of anything the museum has done before or that I've been allowed to do before...but still, I see weaknesses baked in b/c of budgets and processes prior to my involvement.

@will Hi. Looking for other practitioners and agitators on this, too. It's a part of #EquitableEvaluation practice - and not even the hard part.

Most of the time, I honestly don't even understand how I was invited to be in community and practice with such wonderful people. I'm okay with that mystery (I think). If you have the chance to talk with them, do so. Please.

#EquitableEvaluation

https://www.linkedin.com/feed/update/urn:li:activity:6996560061015748608/

Most of the time, I honestly don't even understand how I was invited to be in community and practice with such wonderful people. I'm okay with that mystery (I think). If you have the chance to talk with them, do so. Please.

#EquitableEvaluation

https://www.linkedin.com/feed/update/urn:li:activity:6996560061015748608/

Most of the time, I honestly don't even understand how I was invited to be in community and practice with such wonderful people. I'm okay with that mystery (I think). If you have the chance to talk with them, do so. Please.

#EquitableEvaluation

https://www.linkedin.com/feed/update/urn:li:activity:6996560061015748608/

Analyzing #evaluation data from an exhibition and wow, the rating data are so clear. Significant change happened, and even in the intended direction!

Then, I move to the open ended interview data that goes along with those ratings...and the change situation becomes much more nuanced. And less certain. And messy.

I'm here for it. Just hoping that other folks at the org are, too - because a response will be required if they're serious about org #values and intention!

#EquitableEvaluation

Analyzing #evaluation data from an exhibition and wow, the rating data are so clear. Significant change happened, and even in the intended direction!

Then, I move to the open ended interview data that goes along with those ratings...and the change situation becomes much more nuanced. And less certain. And messy.

I'm here for it. Just hoping that other folks at the org are, too - because a response will be required if they're serious about org #values and intention!

#EquitableEvaluation

#Introduction #Migration Hey everyone. I'm trying out a couple instances to see where my main social home should be now. I'm an evaluator, ethnomusicologist, and quasi-museum person.

Unapologetically for equitable evaluation practices and direct talk about our assumptions and biases in research and evaluation.

Also, as of December looking for new projects!

#evaluation #museums #nonprofits #EquitableEvaluation #DataAreNotNeutral

Lots of nonprofit programs would benefit from an IRB-like process. But even the federal grant programs seem to lack appropriate guardrails.

One program that I got salty about recently (and posted my email response to their RFP publicly) had no business being funded by IMLS. It is actively doing harm. Yet the program continues working with vulnerable populations while claiming "social justice values."

#evaluation #EvalRealTalk #EquitableEvaluation