Skip to content

Robert Kelchen

  • Home
  • Blog (Kelchen on Education)
  • CV
  • Research
  • In the News
  • Teaching
  • Higher Education Accountability
  • Home
  • Blog (Kelchen on Education)
  • CV
  • Research
  • In the News
  • Teaching
  • Higher Education Accountability
Robert Kelchen

Tag: public engagement

A Plea for Simple Slides

It’s hard to believe that it is already time for the traditional academic year to begin. It seems like commencement was yesterday, but instead this week marks new student orientation and preparing to teach my first class of the fall semester on Monday. Unlike the common perception that faculty really don’t do much during the summer, I averaged one trip per week for research and meetings, taught a class, and tried to do as much writing as possible while still taking a few days off.

All of this meant that I spent a lot of time preparing and watching presentations. There was tremendous variety in presentations, with some being wonderful and some being not so wonderful. And I am particularly sensitive to how presentations are conducted, as I have a hard time with small font and weak color contrasts. (I had two eye surgeries as a child, and sudden motion and depth perception have always been an issue for me.)

My visual limitations aside, nearly every person presenting information to a professional audience would benefit from trying to keep their slides as simple as possible. I offer a few recommendations in this post.

(1) Prepare slides for a challenging audiovisual setup. I always advise my students to prepare for any presentation as if they will be in a large room with a small projector screen. While presenters will sometimes know the room they are using well, in many cases they will be walking into an unknown situation. Making sure that slides can be easily read in the back of a large room is far better than having people unable to read your slides because the font is too small. (After all, people tend to gravitate to the back of the room for most presentations!)

(2) Don’t overload slides with text. Novice presenters often compensate for their nervousness by putting everything they want to say on the slide—and then reading off of it. When the audience sees lots of information on a slide, their inclination is to try to read through it as quickly as possible in case the presenter goes on to the next slide. This results in nobody paying attention to the presenter—and everyone starting to pay attention to their phones instead.

(3) Think about colorblindness and other vision issues. Another concern to consider is whether your audience members will be able to see your text or graphics as intended. Color blindness affects millions of Americans, which can make a number of colors look similar. A classic example of this that I use in my teaching came from a game that the New York (ahem, New Jersey) Jets and Buffalo Bills played with all-green versus all-red uniforms. Color-blind viewers couldn’t tell which team was which. (Here is a resource to check your slides for color contrast issues.) I also think of my wonderful friend and Temple University economist Doug Webber, who is legally blind. I struggle with reading slides more than most people, but my goal is to have slides that can be read by nearly everyone.

(4) There is no need for fancy transitions or dancing clip art. I grew up with that dancing Microsoft Office paper clip of the 1990s, and I was not at all sad to see Clippy hit the unemployment line during the recession of 2001. Clip art like Clippy never served a useful purpose and only serves to distract people at best and scramble their circuits at the worst. Prezi slide presentations are the exact same thing—the sudden and violent transitions make me physically ill and they add no value to presentations. A solid presenter can make people pay attention to their words instead of their (not-so) stunning visuals.

(5) If possible, raise concerns about readability of slides. Presenters usually make their slides while sitting close to a computer screen, which makes slides much easier to read than they are for most audience members. And unless someone has vision issues or a close friend with vision issues, they have probably never considered the accessibility of their slides. This means that someone has to tell them that there are issues with their slides. As a newly-tenured faculty member, I am perfectly comfortable going directly to the presenter and sharing my concerns, but junior people may wish to go to someone else who can speak to the presenter.

Finally, I remind my students that the bar to clear to give a competent presentation in higher education is reasonably low (after all, most people are socially awkward like me). By keeping slides simple and trying to deliver a few key messages reasonably well, presenters will look quite good even when they don’t feel fully confident in their abilities.

Unknown's avatarAuthor RobertPosted on August 20, 2019Tags public engagement, research, teaching

Four Questions to Ask When Reading Education Media Coverage

As many readers of this blog know, I like to start my weekdays by catching up on the education news of the day during the 5:00 hour of the morning and sharing a few particularly interesting pieces via Twitter. But a few times every month, I see coverage of reports or articles that leaves me grumbling over dubious methodology or a lack of critiques of the work. For example, there was a piece in Inside Higher Ed this week looking at a report by a little-known consulting group that set off flashing alarm bells in my head as the sun was rising. Judging by the tweets I received in response to my quick take, it is time to expand my thoughts into blog form.

https://twitter.com/rkelchen/status/1024241934234251264

Here are my four questions that everyone should ask when reading media coverage of new research in the education world (and some of these also apply to the research itself).

Question 1: Is information available about the data and methods? Even in online-only media outlets, journalists are often operating under word limits and cannot get into the full details of a study. This means that some important questions about the study’s data and methods may not be answered without looking at the full report. Sometimes, academic articles can be hard to get from behind journal paywalls and think tank reports are slightly delayed due to the use of embargoes and fancy DC releases, but they can generally be obtained fairly easier. But be skeptical of coverage of reports that are not being released to the public, as the work may not be ready for public scrutiny in spite of getting media attention.

Question 2: Do the author(s) properly describe the results given the research design? There are two common errors that author(s) make in both writing up their research and talking about it with reporters. (Granted, the latter is harder than the former, given that most researchers don’t get trained in talking with the media.) The first is to overgeneralize their results; if a study took place at two colleges, the results would likely not hold across all of American higher education. The second is to confuse correlation with causation by using causal language such as “impact” or “effect” to describe observational studies or regressions. (Save that for quasi-experimental or experimental studies, as spurious correlations abound!) Also, for survey research, avoid false precision (like reporting two decimal places as in the IHE piece mentioned above) and be clear about things like recruitment strategies and response rates. Qualitative researchers, in my experience, tend to be much more thoughtful about their study’s limitations than do quantitative researchers.

Question 3: Did the reporter interview the author(s)? In March, I loudly called out a report by a website called the Student Loan Report that claimed 21% of students used at least some financial aid funds to buy bitcoin. But the report still received coverage from outlets such as The Chronicle of Higher Education’s daily briefing, Inside Higher Ed, and CNBC. It turns out that the “author” of the report, Drew Cloud, was not a real person following a Chronicle investigation. Yet the company got away with his online presence for years because he would only do short e-mail interviews. Researchers are often concerned about the unpredictability phone interviews and have a hard time fitting the time into their schedules (trust me on this—I do several of them every week, including an unscheduled interview while writing this post!), but it’s a good way for reporters to probe deeper into the study and verify that the author is a real person. E-mail interviews can be appropriate (and I do them on occasion), but phone interviews are ideal.

Question 4: Did the reporter talk with other experts? Before a publication runs a piece describing a new research study, the editor should always make sure that the reporter talked with other experts (content matter and/or research methods) to verify the quality of the study. For example, a recent Inside Higher Ed piece covering a new article on the implications of open educational resources for students did this very well. The reporter talked with three outside researchers (myself included) as well as both of the article’s authors to give readers a fuller picture of the study. Going back to the Drew Cloud saga, my persistent gripes on Twitter led to a Chronicle piece in which I was interviewed about the limitations of the dubious bitcoin survey so at least some readers could get an outside opinion of the study.

Unknown's avatarAuthor RobertPosted on August 1, 2018August 1, 2018Tags media, public engagement, research2 Comments on Four Questions to Ask When Reading Education Media Coverage

Junior Scholars Have Much to Lose–and Gain–From Public Engagement

I have written a few blog posts in the past on why I feel public engagement is important for academics—even for graduate students and early-career faculty members. Because of my public engagement, Education Week asked me to contribute to a series on how education scholars should join the public conversation. This series immediately followed the release of Rick Hess’s annual Edu-Scholar Public Influence Rankings, which included me in the rankings for the first time. My piece focused on some of the potential concerns junior scholars should be aware of before pursuing a public-facing career and is reprinted with permission below.

 

The new generation of academics is coming of age in a more exciting—and more challenging—time than ever before. The importance of social media in education policy discussions has given junior faculty members (such as myself) the opportunity to become nationally known in a way that would have been nearly impossible even a decade ago. But in an era when facts that don’t fit one’s preferred political narrative are dismissed as “fake news” and when some colleges claim to value public engagement while not rewarding it in tenure decisions, young academics interested in becoming public scholars should proceed with caution. Here are my four cautions, three aimed at scholars and one aimed at their colleges:

(1) Academics should be aware that everything they say online or in an interview (unless it is explicitly stated as being off-the-record) could end up reaching a broader audience than initially expected. It can be tempting to use social media to vent about the current political environment or use humor to opine about topics unrelated to education, but this carries two risks. The first is about the ability to engage policymakers on both sides of the aisle—if legislative staffers check out an academic’s Twitter account and see a number of posts opposing their party, they may not listen to his or her research. The second is gaining the attention of internet trolls who try to make people’s lives miserable for sharing their political opinions; this is a particular concern for female and minority scholars, who are disproportionately subjected to online vitriol. I won’t say to avoid getting into politically charged debates, but scholars should be aware of potential concerns.

(2) Academics must keep the importance of high-quality research front and center. The importance of rigorous research designs (both quantitative and qualitative) is a hallmark of our doctoral training. It is essential to emphasize the nature of this rigor on social media and when speaking with journalists or policymakers. There are plenty of partisans out there promoting so-called “research” that would not get a passing grade in a research methods course. Driving home the importance of high-quality research (and explaining to the public why certain studies cannot be relied upon for making policies) is crucial, even if the findings of these studies do not match one’s prior beliefs.

(3) Junior academics should be mindful of the ticking tenure clock. Assistant professors have a limited amount of time to produce the research necessary for tenure, so public engagement must be viewed as a trade-off. Is spending half an hour a day on Twitter likely to pay off by producing potential research collaborations or opportunities to influence policy? I happen to think so, but spending time on social media needs to be a part of an overall strategy to earn tenure. It is worth spending time being strategic about social-media engagement in order to get the best return on one’s investment of time.

(4) Colleges that support public engagement must step up and actually provide the necessary support to their faculty. Universities that expect their scholars to be engaged in the public sphere should provide written guidance about how this engagement factors into the tenure and promotion processes; otherwise, senior faculty on tenure committees may be less likely to give academics credit for their work. Universities must also be willing to stand behind faculty members with actual statements of support (not just a notice that scholars’ social media activity is their own) when the internet trolls come out of hiding. If they fail to do so, then a generation of young academics may be cowered into silence.

Unknown's avatarAuthor RobertPosted on January 20, 2018Tags faculty, public engagement, research1 Comment on Junior Scholars Have Much to Lose–and Gain–From Public Engagement

Searching for New Higher Education Policy Voices

I started this blog back in August 2012, when I was finishing up my dissertation at the University of Wisconsin-Madison. 269 posts and nearly 100,000 on-site page views later (as well as the normal research, teaching, and service activities), the beginning of 2018 means that I will be submitting my tenure packet later this year (gasp!).  Assuming everything goes well, I will not be a junior faculty member for much longer.

One of the best parts of my job is the interactions with doctoral students, postdocs, and newly-minted assistant professors. Through serving on search committees, being a discussant at conferences, and participating in conversations on social media, I’m thoroughly impressed by the cohorts of scholars who are beginning to enter research and policy discussions. And from being on search committees…it’s amazing how qualified job market candidates are today. I doubt I would have been able to get my current job today with the CV I had back in 2012!

This post is inspired by a nice tweet I received from Roman Ruiz, a doctoral student at the University of Pennsylvania. He just launched a new personal website that is both visually appealing and a reminder of how old I am rapidly becoming.

Excited to share my new personal website: https://t.co/yITgJRR4Ea
U.S. Higher Education Data Analyses and Visualization. #highered #dataviz

— Roman Ruiz (@RomanHigherEd) January 2, 2018

I would like to begin 2018 by highlighting some of the great new higher education policy voices out there like Roman. If you are a doctoral student or very early-career scholar who does public-facing higher ed policy work and has an active Twitter presence and/or blog, I’d love to feature your work. (Senior faculty: you’re encouraged to highlight some of your tremendous students!)

Just fill out this very short form and I will share the list in a future blog post. I would also love to publish guest blog posts from new scholars, so please let me know if you are interested in sharing your work with a broader audience.

Unknown's avatarAuthor RobertPosted on January 3, 2018January 10, 2018Tags graduate school, new higher education policy voices, public engagement2 Comments on Searching for New Higher Education Policy Voices

Five Takeaways from Five Years of Public Engagement

When I was beginning my final year of graduate school at the University of Wisconsin-Madison, I started a blog with the goal of thinking through some of the interesting issues in higher education policy by writing about them. I joined Twitter a few months later (in February 2013), and I’ve done my best to consistently use both of these venues to reach out to a broader audience and to learn from people far more knowledgeable than myself. Through 255 blog posts and nearly 24,000 (!!!) tweets, I have been able to be a more effective researcher and teacher based on the resulting conversations.

This week marks the fifth anniversary of my blog, Kelchen on Education. To celebrate, I relaunched my blog on my new website (robertkelchen.com)—which now has a more mobile-friendly layout and contains links to my CV, research papers, and media coverage all in one place. In this post, I share five takeaways based on what I have learned in the last five years about how to be a publicly-engaged scholar.

(1) Blog posts and tweets can spark new research ideas. Yes, there are many opportunities to waste time on the Internet watching cat videos or doing a million other unproductive things. But the ability to quickly reach out to a broader audience can result in useful collaborations. A good example of this is a 2014 discussion that was sparked by a new data release on colleges’ living allowances for off-campus students. A number of people shared their skepticism regarding some colleges’ low living allowances (see coverage of one of my tweets here), and I ended up teaming up with Sara Goldrick-Rab of Temple University and Braden Hosch of Stony Brook University to write an article on the topic that was recently published in The Journal of Higher Education.

(2) Be patient. Starting a blog or a Twitter account doesn’t instantly result in a broad audience. A number of my early blog posts got fewer than 20 page views, while it took me about a year to reach 300 followers on Twitter. Public engagement requires patience and a significant time investment, which may not make sense for everyone—particularly for people whose tenure (or reappointment) clock is already ticking loudly.

(3) Be consistent. In order to build engagement with the broader community, consistency in posting is essential. I tried to write at least one blog post per week and tweet 2-3 times per day (not just retweeting others) when I started using those platforms, just so people would be able to readily find me and my work. Once established, the frequency can change somewhat.

(4) Find your voice. Although it’s painful to look back and read through some of my verbose blog posts from nearly five years ago, these posts did help me find my voice in writing for the public. The Chronicle of Higher Education once referred to me as “a reliable source of deep-weeds wonkery,” which is pretty much what I aim to do. I’m not the kind of person who likes getting into political discussions that are unrelated to educational policy on social media, although I will occasionally share some gardening pictures or tweet about my beloved St. Louis Cardinals (so folks know that I’m a real person instead of some robot that is programmed to tweet most weekdays between 5 and 6 AM ET). Within a few months of getting started, find your comfort zone and go with it.

(5) Be responsive. Journalists and legislative staffers frequently use social media to reach out to academics…and although they needed your answer by yesterday, they may be willing to give you a few hours to respond. Set your Twitter messages and mentions to go to your e-mail or phone on a fairly regular basis, and do your best to respond to e-mails within a couple of hours. If people on deadlines know that you are normally able to help them out in a pinch, your work will start getting a lot more traction.

What other things should academics with an interest in public engagement do in order to have a better chance of success? Send along your thoughts in the comments section!

Unknown's avatarAuthor RobertPosted on August 27, 2017August 27, 2017Tags public engagement, research, social media1 Comment on Five Takeaways from Five Years of Public Engagement
  • Home
  • Blog (Kelchen on Education)
  • CV
  • Research
  • In the News
  • Teaching
  • Higher Education Accountability
  • Home
  • Blog (Kelchen on Education)
  • CV
  • Research
  • In the News
  • Teaching
  • Higher Education Accountability
Robert Kelchen Blog at WordPress.com.
  • Subscribe Subscribed
    • Robert Kelchen
    • Join 192 other subscribers
    • Already have a WordPress.com account? Log in now.
    • Robert Kelchen
    • Subscribe Subscribed
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar