week three discussion polymetrics

It's spring break here for my kids, which is kind of weird because we just had snow. You have some nice weather there. Hi, J.C. Hello. How are you? Can you hear me? Yep. I can hear you tonight. Yeah. So it's working. Yeah, I got it. I'm working on it. Thank you. That's good. Nice. Well, Melissa, you look you have such a nice background there. Nice windows in your office. I'm so thankful because I've had so many offices throughout my career at different times where I've had no windows, small windows, and it's horrible when you have no windows and you come in in the dark and you leave in the dark and I can't get any sunlight, but oh well. That's hard. But at least you've got a good space now. It does make you appreciate it when you've had other things. Absolutely. Hi, Frank. I see that you're here too. And I see some others here as well. Hi, poor bear. All right. How are you guys doing this? How was your experience with the week to assignment? Any questions about that? Any challenges or overall pretty straightforward? What was that? Dr. Kelly, you talking to me? Oh, no, I was just wondering if anybody had any feedback about the week to assignment. I see Julian said all good. Just wondering how others experience was if anybody, if that was pretty straightforward or if you had any challenges with that. I just had a challenge with attention to detail, that's all. I cleared that up. Yeah. Yeah, well, it's hard sometimes, too, with the shorter papers to kind of, you know, get enough information in there that's like, like you said, attention to detail. That's like the good information you want to share and not have too much. so that can be a challenge but hopefully it was pretty straightforward I did want to talk tonight about the the new week three discussion and assignment so I'm going to talk about that we're going to spend most of our time working on creating our instrument that you guys generated items for in the discussion But first, I want to talk just a little bit about your discussion and your assignment this week so that we can, you know, know how much time we have remaining for looking through the items. So for the discussion this week, I'd like you to discuss how we should approach data collection for our self-esteem measure. So think back to Klein and what steps he said you should be doing in developing a measure. Some of these will already be done, right, by the time you get to this discussion, right? So some of the steps are going to be done. So it's like now, what are the next steps? Like what strategy should be used to figure out what items to keep? what strategies should be used to test reliability and what strategies should be used to validate the instrument and there may be different stages to data collection as your measure will change as you go through the process so often you have to go out and collect data more than one time as you go through some of these different steps so just talking just you know kind of making sure you guys are familiar with this. I know I was oh hi Charlie no problem I know I was reading a dissertation earlier today very good dissertation but the student said that they were reporting some things and said that that showed reliability and validity and they had reported Chromebacks Alpha, which is a measure of internal consistency, so how well the items hang together. So like for self-esteem, we want to end up with, you know, pretty decently high Chromebacks Alpha. Like, you know, if your measure, if your score can be anywhere from zero to one and a one is perfect, we're not going to get a one, right? But if you have above a point eight or especially above a point nine. That's very strong. That means our items are really hanging together pretty well. So that's a measure of reliability. There are other measures of reliability as well. But what the things that they had reported did not do was didn't have anything to do with validity. Like if you're reporting mean and standard deviations or correlations, that really doesn't necessarily have anything to do with validity unless it's like you're doing like predictive validity, right? Like, are you going to look at, well, does self-esteem predict self-ethicacy or some other related construct? Or does it predict, like, other measures of self-esteem? Like, does our measure of self-esteem correlate decently well with Rosenberg's measure of self-esteem? That could, you know, in those cases, you could do a correlation. But, you know, I just want to make sure you guys understand here, like, what's the difference between reliability and validity? You also had this in research methods. You know, this has talked about in some of your other classes. I believe maybe even talked about a little bit in cross-cultural tests and measurements. But here we're just really talking about what's our strategy? When we're developing an instrument, what do we need to do? So these are kind of going through like some of the remaining steps that you would ideally go through after you generated items. So, you know, just go back to your book and kind of review and talk some more about you know, strategies and what we should be doing. Susanna, did you have a question? Yes, thank you. So I was kind of confused on that first part, the strategies, because it's very, like, wild to how far we go, like we start after we have the items we have the test completed and then we try to you know explain what we're going to do after that for collecting data or is it strategy is just about the whole like all the way from a beginning so I don't know where yeah that's a good question great question so you don't need to start from the very beginning because like we started out with defining self -esteem and then we we generated items um now tonight we're going to serve as subject matter experts and try to call down our list of items because actually there was over a hundred items when I pulled them all out and I just you know reduced it to about 50 because there were quite a few, as you can imagine, duplicates or almost exact, you know, similar wording. But let's say we have 50 items. We want to reduce that. And then what are the next steps? Like here it says, what strategies should be used to figure out what items we should keep? Well, that's something we're doing tonight, but you should still talk about it, right? What does a subject matter expert do? Like, you know, what would you do if you were doing a study where you were developing an instrument and you wanted to have subject matter experts help you figure out what you should be keeping and what you should be getting rid of? And then in terms of testing reliability, next week we are going to be doing the type of reliability that I just mentioned that just was in the dissertation I read today, and it's basically at almost every dissertation I read is internal consistency. You always have to report that if you're using a survey instrument, and many of our students do use survey instruments, not everybody. But we will be doing internal consistency next week, and that is where we figure out, you know, truly which items hang together and if there's any we need to discard so we'll be you know narrowing down the list a bit tonight but that doesn't mean that's going to be our final list of items so one of the steps will be internal consistency we will do that as a class Monday night and then you guys will have a different data file that you'll do internal consistency for your assignment so next week there's a focus on that. And then there's other, you know, things like, for example, if anybody hadn't corrected their reverse scored items, I just threw those out, you know, because I gave an opportunity to fix those. But if you didn't, you know, if you didn't, then I just took them out. And then also, you know, just think about the whole process of validity, like how do you determine if it has the different types of validity. So it's just sort of basically going through all the different stages for reliability and validity and what you would be doing with a new instrument. Thank you. Yeah, I was kind of like lost because all of these steps required substantial like pages and pages to explain. So I didn't know how to put it into a post for discussion board. I'm just like shorter version of the whole thing. I don't just want to list stuff, but I want to explain. Right. Lots of it's very complex. Well, I appreciate that that you say because, yeah, that's true. I mean, there can be some complexity, but, you know, it's not necessary to do every, you know, to go into depth about every. single aspect, just kind of giving a general overview to make sure. Oh, sorry, I just want to make sure I do. Didn't lose you guys. So, yeah, just to kind of make sure you have an understanding of the different types of reliability and validity that you would be looking at with a new instrument. So just kind of a little overview. Obviously, a discussion post should not just be one paragraph. especially for something like this. If you had one paragraph, I don't know how you could possibly do this. But at the same time, you can't have two or three pages, right? It can't be incredibly long. So I guess there has to be the balance between being clear and concise and covering the materials. Joseph, do you have a question? So do you want us to talk about like the reliability and validation of the measure throughout the entire use of the measure or just like after the initial creation and like the introduction to research? So like pilot study and up to there or doubt the entire use of the measure? just you know just like in the like as you're developing a new instrument so right gotcha you know like for example you could do something like test retest but maybe that's you know maybe that's right well early stages right so it's just sort of like what do you need to do to get your your instrument together. I was just thinking like technically Rosenberg scale is still being validated with replications if it's used now. But that's all this thinking. Anyway, thank you. Yeah. Okay, sure. And any other questions about the discussion? I do see. So Shelley, I'm just asking because somebody else just sent me an email. Was there a particular challenge getting into the room? Yes. I had to go through Explorer instead of Chrome. And then I, every time I pulled up Cultural Live, it would say it wasn't available. Right. So, I mean, maybe, just so everybody, I guess, who's here knows, because there's two sections of the class, you can only enter through your classroom if you're in section one of this class. Otherwise, you have to enter through the link that I put in the announcement. it. But whether you're in section one or in section two, you can enter through the link. It's just, you know, and I didn't, it's not like any preference for section one over section two. It's just the link is in. So just so you know, if you're in section two, if you try to click Kaltura Live, you will get an error. But hopefully it'll be pretty straightforward. then um well i did um i did hit the link because i was early oh and i sat there and it said um i was being wait there you weren't there it wasn't available yet because you weren't there so i said i've been i've been there since like 620 and all of a sudden like nobody was showing up and i'm like what's happening so i went back out and then i tried culture alive and then i couldn't get in so then i tried the link again and it kept showing error so then i went to explore and did the link and that's when i got here yeah okay well i mean in the future i can i can open the class early i guess the reason why i don't do that is sometimes i open it early and people think that i'm there and like ready to uh converse and start like talking to me but i'm not necessarily there like right now i was still working on the items like so it actually is a lot to compile all these i'm not used to this you know having two sections of this class and there being so many so i had over a hundred items then i was narrowing it down too because there were a lot of duplicates but anyway i can open it early but just no don't think i'm not talking back to you it's just i may not be i may have my volume off or something like that it won't be it's It's not like that I'm ignoring you. It's just a lot of times I'm doing things before class. Okay. Well, thank you for explaining that because that helps me to know what's going on then. Okay. So Joseph, did you still have any other questions or is that just raised? That was still from last time. Okay. No problem. Okay. So for your discussion, we already talked about. this. For your assignment, your challenge this week is to describe how a researcher might handle missing data when conducting a research study. So there is a little bit in the textbook about missing data, but it's also useful to look at Chapter 4 of Tabachnik and Fidel. That's kind of a gold standard statistics book, as well as David Howell's page. define how missing data methods can affect the results in other words like you know think about the patterns so those of you who've taken RSM 801 know we also talk about that in the missing data in that class but you know it depending on the patterns of missing data it depends on you know how you would handle it but both this Tabatchik and Fidel chapter and David Howell's page are in the week four assignment area, so you do have those resources. And maybe even more importantly is this last part of the question, what precautions can you take in advance? I say you, because you'll all be researchers, at least for your dissertations. What precautions can you take before starting data collection to try to prevent the missing data. So really, I think, you know, there are oftentimes some missing data, but we as researchers can try to design our instruments and our studies so that we can try to minimize that. And so that's, you know, where you can talk about that. So again, this is just a two to three page paper should be relevant. relatively short, but just to kind of make sure you understand and you are thinking about this issue, because it does come up quite a bit when you're doing research. Susanna? Sorry, I have a question again. So the first question that has us to describe how we handle missing data. So again, there's a huge moment. of different ways? Do you want us to use the ones that they are recommended or also go through every single one that also nowadays is not recommended and explain why it's not recommended or just concentrate the most used one, recommended ones? Yeah, I would, you know, really like at an ideal situation, you would talk about how you would handle missing data if it's missing. completely are at random or missing at random versus how you would handle it if it's missing not at random. There can be different techniques depending on that, but really you don't have to spend a lot of time on techniques that are not advised or not commonly used. You know, there are, yeah, I'm sure there are many different ways you can handle missing data but really they primarily break down into three categories i would say that's what i was missing so i didn't know if you're actually here that i've had to explain the you know paravise and single invitation methods and model-based methods or we're just concentrating on the mar car and car um i was confused about that or do we have to do both no i mean i always i mean when i teach obviously like for this it's primarily reading and not you guys are learning through the reading but when i teach it in rsm 801 you know we kind of focus on the you know general categories like obviously there's deletion you can just get rid of you know the missing data um there's mean substitution, which is kind of the easiest, like SPSS. I think that's what they do with their missing data function, but there's pros and cons of that. And then, of course, there's multiple imputation, which is more like doing a regression analysis. So it's more sophisticated. If you have one missing case, is it going to be worth it to do multiple imputation? You know, so you've got to think of the cost versus benefits of like what would be the best technique versus like if you have just a few cases missing or maybe you just have a few items missing let's say we have a self-esteem instrument that has you know 10 items if somebody just missed one item like what's what's the kind of the technique you would use versus well what if like 20% of your what if 15 % of your data is missing. But it's like really valuable data. It's like a longitudinal study. So you're not going to throw up 15% of your sample. What are you going to do? So it's sort of just kind of answering those kind of questions. I don't expect you to go into detail about every single possible way you could deal with missing data. It's sort of more like bigger picture. Like does that make sense? Yes. Thank you. so with the mark i call it more car and car but with every each possibility i can kind of mention the types of how we will handle for each case right kind of okay thank you sure yeah um great all right um so um great great now what i think i'm going to do is i'm going to share my screen where i've put together um an excel sheet that has some of your self -esteem measures which great job. By the way, you guys, I thought, you know, there were a lot of great creative examples. For this instrument that we're doing as a class, we are going to use a Lycurt scale. As we talked about last week, if we use a five -point Lycurt scale, which I think many of you did, you know, and I strongly agree to strongly disagree or strongly disagree to strongly agree. We have a five -point instrument so just would think about these items go through the items thinking about obviously they're going to people are going to have to answer if they to what extent they agree or disagree or whether they're neutral like they neither agree agree nor disagree so we may have to reword some things but also we have to take some things out because there's just too many items I think like I think I started out with about 110, and then, you know, now narrowed it down to about 50-ish, because, of course, there were some duplicates, and I may not even have taken out all the duplicates. I'm sure we'll run into some more. When I say duplicate, of course, the wording's not exactly the same, but it's very close. We don't want items that are too close because they each should be measuring something unique, although they should be related, right? They should all be related to self-esteem. So we're going to pretend we're the subject matter experts. We'll take a look at the items. Please don't take any offense if anybody says it's not good or we should throw it out. That's, you know, basically what an expert would say. They might just say like, oh, I don't think that fits as well. And if we need to modify anything because we want really concise direct statements, Remember, we don't want anything double-barreled or reversed items. So I will, I'm going to turn off my video just because it's kind of, I won't be able to. I'm not going to see the screen, really. I'm just going to be sharing my screen. So please feel free to jump in and share your thoughts as we look at these. items. Can you see the Excel spreadsheet? I may need to try to make some of these items a little bigger, but... Yes, I can see it. Okay, great. Great. Okay. So let's just go through these. We'll see how many we can go through. I don't know. We'll be able to go through all of them, but hopefully we can get through a big chunk. And we're know we're not going to worry about how many we have. We're just going to go through the items and say, does this measure self-esteem? Do we want to keep it or do we want to not keep it? So what about this first one? I feel confident in my ability to handle challenges in life. I like that one. Yeah, I would say that's a good one, right? That measures challenges, challenges, which are important beyond this general self-worth. So I think that's a good one. I think that's a keeper. Okay. Number two, I am confident that I am as good as others. I like that. I like that one. Results in 16. Okay. I have kind of a question about that because I do not. I have problems with comparing people to me or me to other people in a way that I don't know what good at others means. You know, like if I'm talking about me as a patient, pretend patient, I will be confused about what other people means. And nowadays comparing people to people, social media, et cetera, can be unrealistic and can cause actually. feeling like I'm not good enough. Yeah, I'm kind of mixed on this one, but I'm with you. I think because we have so many items and hopefully we have other strong ones, I'm going to take it out because I, I mean, if you all agree, I do think that. I think that it's the same pretty much as three, and I kind of like the wording of three better. Yeah, I would agree with that. That one that we just delete it was actually mine. after I went back and read it, was kind of like, this could be a negative or a positive. Yeah. I think it's like it has some good elements, but I do agree that three is like. Better. Yeah, it's just a little, it does add a little nuance about comparing to others, but it's a little clearer how compared to others, which could be. That one was a little gray. Yeah, it could be a little gray. Okay. It takes out the qualitative. of good, basically. It just says that you're of worth as much as other people, which depending on your opinion of other people doesn't have to be that much worth, you know? Right, right. Yeah. Right. Okay, so so far we have number one and number three. Let's let's go to number four. I tend to feel satisfied with myself most of the time. I don't think so. That is good because people, They don't have to accept their limitations in their low days and high days, not just always being perfect and satisfied. That's not realistic. Yeah. I would agree with that. I don't know. There's something about this one where I'm like, it's not, I don't know. Yeah, it's maybe just. Oh, clarity too. I tend to feel satisfied. Yeah, I think there's a little too many words in here because I feel like, We're trying to assess self -esteem at a moment and time. And I think that this is like trying to make it take up too much time. Like, just like, let's assess how people feel right at this moment rather than most of the time or tend to. So it's not precise enough? Yeah. I would just like, I would just, like, we could rewrite it, but we have so many that I'm kind of more leaning towards. let's just let's just pull some out and if we have to we can always rewrite some but it would probably be deleted too then it's like of the same nature yeah um okay do you want to say more about that well i mean it's like what do you think good is and i feel like i am good enough what it's at a like or tell where does that go yeah what's good enough yeah what's good enough good enough just average or you just good enough like by your own standards so the word enough is the one that is kind of yeah okay um i respect myself as well as i respect others relative again that one can be a little bit ambiguous as well i think because what if you just don't respect other people that means you don't respect yourself right um some people might respect other people more than themselves and have more self -esteem but yeah this is a little okay so how about i feel proud of my achievements that's a good one good one yeah i think that's clear right it's like goes beyond general satisfactions. You might want that to feel good about yourself. Okay, how about I trust myself to handle challenges in life? Good. It's the same as the person. That's the same as the first. No, that's true. Good point. Okay. I feel valued. Not good. Because you're relying on the other people's reaction. We actually. towards you not how you actually feel about yourself I mean it depends on your model of self-esteem too because you're like I was talking about a two-factor model where it's your self -worth but also your perceived like worth in others so you could say I I love myself just like you could say I feel valued like you value yourself so I do I I think it is good to have, you know, something like I feel valued or I feel like I matter. Like, does your self -esteem incorporate how you believe others see you is essentially what? But is it not like if you are around a society or environment that is not actually a positive environment. And now your self -esteem depends on the environment, not on your. your own belief, you can be, I'm talking about the overall people that we, they can have different, you know, environments and they feel that environment is just downing them down. The family is not nice about them, but doesn't mean that they should not feel good about themselves because the family is not valuing them. Mm-hmm. Well, I think you're both. The question is, does someone have, does the perceived value actually do. tell you about self-esteem? That's the question. Well, I think you're both making good points. I think this might be an item where it's good to keep it because maybe we want to reword it a little bit, but I think feeling valued does, you know, is related to a healthy self-esteem. But I think you're also making good points. I don't know if that was Susanna or somebody else. We don't know if it's going to hang together. But we'll find that out next week when we do the internal consistency. So not all the items are going to hang together, right? So when we do that test, we'll see which items actually we have to throw out because they're measuring something different or they're measuring the same thing. And it could be something as simple as rephrasing it like, I feel valuable instead of valued, and that places it more on themselves instead of that external thought process. Good point. Or you could put in, due to my level of self-efficacy, I feel valued. So maybe we tie it into the fact that that person has accomplished so many things that built their confidence up that other people's opinions don't really affect them, like they know what they're capable of. Well, we do have other, a good point, but we do have other items that assess self-efficacy. So let's just keep this focused on either valued or valuable or what do you guys think? Would you keep it like this? I feel valued or I feel valuable. What do you think? You feel valuable? I don't know. I don't have like a strong opinion about this. I feel valued. Okay. Then we'll just keep it the way it is. Okay. How about I accept myself as I am? I like this one. I think it's too. I like that too. I like that one too. Okay, great. I feel that I have a number of good qualities. That's a good one. That's a good one. Well, that means number. Like a number can be like it's more than a lot. I feel that have good qualities, maybe we're going to be good qualities. Okay. I feel comfortable expressing my opinions in social situations. I don't think that's specifically for self-esteem because it could be a measure of extroversion or introversion. But if they have a psychologically safe environment where they work for, that could tie into that, because then they feel more comfortable to say what they mean and talk about how they feel and not be judged without repercussions. But that can be also connected with the IQ and EQ. So are we now measuring? That's true. It could be a multiple of things. It could be a matter of specific enough to self-esteem to be on a self-esteem measure. It could be as simple as shortening. sentence in, I feel comfortable with expressing my opinions, period. The question is, do you have to feel comfortable with expressing your opinions to have high self-esteem, or can you feel comfortable not expressing your opinions and have high self -esteem? Yeah, see, I kind of like, I guess, I don't want to go against the group, but I kind of like that it had something social, just because it was like a little bit of a different aspect of self-esteem. But, again, it could either hang with the other items or it could not, you know, because it is assessing a different aspect. I don't know. There could be cultural situation where some cultures don't like to express themselves. That's true. I agree. Good point. All right. Well, we can take it out. Okay. So I'm satisfied with myself as a person. The previous one was similar. Oh, yeah. This one just points out that they're a human. Sorry. I believe that I'm a person of value. I like that one better than the I tried. Yeah, I think that's better wording. I think that's better wording. It better than which one? Then I feel like number nine. Yeah, okay. Can you delete the rows and then? Yeah, well, I will when we go through. So I'm just kind of trying to keep track of some of these. So, all right. So I feel confident in my abilities. It's kind of ambiguous, but I like it. I don't know. We have something about confident already. The beginning, right? The confident. Oh, yeah, the first one. So I think the first one is a little better. Okay. Yeah, it's repetitive maybe. Is that a bad thing to be repetitive? Well, we don't want to be too repetitive. We want to try to have, you know, each one. measure something unique but related um okay i believe i have valuable qualities that make me a unique person i feel like that's too similar to 14 yeah i feel good about myself most of the time well i wouldn't have most of the time because we're trying to just look at the you know just at a moment in time but is I feel good about myself any different or unique? I don't feel like that's the same as I believe I'm a person of value. I mean, essentially. Yeah, I think so. I'm personally number 11. Yeah, I don't, I actually like it, but I don't, it seems very similar to 11 and 14. Well, whereas 11 says good qualities and 14th is a person of value. So, yeah, I think I would get rid of 17, even though I liked it. Okay, I feel proud of my accomplishments. That's the same as 7th. Yeah. See, I told you that I didn't get all the duplicates because some of them are hard. It's hard to pull some of them out. Okay. I believe I'm worthy of love and respect. That's two. There's a double. Yes. Yeah. Yeah, so we could either say, I believe I'm worthy of love or I believe I'm worth of respect. Oh, look at the next question. I guess the question is, do we need either of these? Maybe then worthy of love, I'm deserving of respect. Do we need those? Do they add anything? I mean, it does add a little bit of specificity as to what we're saying self-esteem is. But I mean, that's kind of really strong there. I am deserving of respect. I really like that one. Okay. Which one? I am deserving of respect. Yeah. Okay. I think we'll take up the, do you want the love one, too, or do you think just the respect one? It's similar to the beginning one that I'm worthy or something with a worth was. Oh, yeah. So that's repeated. I'm going to take that out. Okay. I am content with how I manage adversity. Yeah, I don't know about that one. Yeah. It's like the spectrum. Okay. I like myself most of the spectrum. at the time. I'll step myself as I am the same one. I feel that I am a person of worth because I contribute to my community. No. Yeah, what's the problem with this one? Well, I think that that's you put in yourself as a person of birth because you do something. Mm-hmm. Like you're doing something. Yeah. So yeah, because it's just focus. on one specific aspect like contributing to my community so that's yeah putting too much in one item okay I feel that I'm a good person because I care about the well-being of others same thing yeah yeah just like trying to what what you're doing for others okay what about 25 I have a general generally have a positive opinion about myself that's not realistic yeah i don't know that that really that seems i don't know yeah that's i know there's something about that that that i feel like is a little too subjective there i don't know i feel i can do things as well as other people my age Again, comparing. Yep, comparing others rather than your own self-worth. Okay, I generally can avoid letting other people influence how I feel toward myself. And that kind of same thing again. What we're trying to measure is like how much they can do that. Like, that's what self-esteem kind of is, you know? Mm-hmm. Yeah, I guess in some way, this could be. This could be. Like, I feel good about myself, regardless about other people's. I don't think that's something, like, I think if that's more of a definition of self-esteem, then it should be an item. Yeah. Well, should we keep it, or should we take it out because it's more of a definition? Yeah, I was, I would think, omit that. It's just a little complex for a, essentially. I got self-report measure. Yeah, okay. I can learn and grow from my mistakes. It's good. I like that one. I deserve to be treated with respect. Ooh, we got another respect. Which one do you like more? I deserve to be treated with respect or I am deserving of respect. I like I'm deserving. I'm deserving. I'm deserving. Yeah, I'm deserving, yep. Okay. Okay. I feel comfortable expressing my thoughts and opinions. I like the other one socially, that said socially like that versus this one. Okay, maybe I need to delete some of these because it is kind of getting hard to. I think we got rid of the one that said in a social... We did get rid of it. Yeah. Yeah. Like, how can I, uh, I think if I'm going to, right click and delete. Yeah. My, uh, my, my computer is like very glitchy. So I may just have to do this the old-fashioned way, which seems ridiculous, but I can't right click for some reason right now. Okay. So I'm just going to pull some of these up so we can't see a little that works too clearly all right um okay so we're at i feel comfortable expressing my thoughts and opinions what do you guys think about that depending on where and with who i don't know if that's a clear self-esteem because that just maybe i feel like you can have high self -esteem and not be and not express your thoughts and opinions right i don't know if that's they're not saying where like what if they're just expressing thoughts and opinions in their car before they go into work right and people do that with their little like i'm sorry okay so i feel that i'm a person of worth at least on an equal plane with others Yeah, at least as much as anyone else. Okay, so we're going to get rid of that. I feel valued and respected by those around me. That's double-barreled, and we kind of already have it. Yeah. Okay, we had to be worthy of respect. I'm satisfied with myself just the way I am. We have I accept myself the way I am. Good memory. I take constructive criticism as a helpful tool. I like that guy. That's a good one. Yeah, that's something different. That's, I don't. Yeah, that's something different. I like it. I'm not sure if it's going to completely hang with the others, but it's interesting. That's something you can even say no to, though? What? I take constructive criticism as a helpful too. If you're being honest, there's definitely a lot of people who do not take it as helpful. If you're being honest. I feel that I'm a person of worth deserving of respect. I feel like we have this already. Okay. I trust my ability to make good decisions. I just think good as a qualifier is. I just, I'm not sure. Okay, I feel confident in my ability to solve problems when they arise in my life. It was a repeat. Yeah, I also think that's... Number one. Self-efficacy, which I think it's good to have some self-efficacy, but not too much. I believe my opinions and ideas are valuable even if others disagree with me I mean you can take out the even if others disagree with me like this better than I feel comfortable expressing my opinions your opinions are valuable and feeling comfortable expressing them are too different yeah all right let's let's move this up I want to move these up so we can see them so is that still add something new i believe my opinions and ideas are valuable yeah that's a little different okay i believe i am worthy of respect and dignity regardless of my achievements or failures ooh what's the problem with this one too birdie yeah there's a triple barrel there yeah a triple barrel there's laughing I don't know we definitely like call it that but yeah there's a lot there's a lot there too much to me asking about too many things um I feel confident in my ability to handle life's challenges the same as the first one same as the top that's true um I I can accept myself as I am today, even as I grow and evolve. That's not too long, timeline-wise, too. I accept myself as I am is the same thing. Yeah. Same as for you. Yeah. Okay. I trust myself to make important life decisions without doubting my worth. I feel like you can, if you take out without doubting my worth, it works just as well. I trust myself to make important life decisions. Is it not the same as I feel confident in my ability to handle challenges in life? Or just, yeah, maybe not. Which is the same as 15. yeah yeah i guess that's a duplicate um yeah i'm confident in my abilities you already has something like that yeah i think so i'm probably my achievements um i feel that i have a number of good qualities. The number? That was a repeat. Number five. Yeah. I feel good about myself even after I failed. That's kind of negative. Mm-hmm. Okay. I believe I can accomplish anything I set my mind to. That's good. Yeah. And yeah, I think that's good. I'm satisfied with myself. Is that the same as four? Yeah, I don't really feel like that's anything. Okay. Almost done. I have some negatively phrased items, which are actually, I think, more challenging to do. Well, but I do think it was good to have some, but this one's not, this is more, I'm going to just knock off this first one because it's worded wrong, but also I think it's more about negative self -perception, which isn't directly self-esteem. Okay, I never compare myself to others and feel I fall short. They're not comparing themselves, then how do they feel they fall short? I don't know, yeah. Hard for ever put that in there. That's tough, yeah. All right. I tend to do. Wait a minute. That was mine, Aubrey. I'm sorry. And I just want to say, I had that as a reverse scored one. And so if I originally read, I compare myself to others and feel I fall short and I was going to reach short. Well, like I said, I don't know. Yeah, but it makes you feel any better. I don't know if we'll end up keeping any of these. We got there. We already have a really good list. And these, a lot of these are like, it's very difficult to write a negative phrase item. So I tend to just doubt my responses as good enough. Yeah, I don't think so. It's still, it's just like self-doubt or uncertainty. So it could relate to self -esteem, but I think not great. Often feel insecure about my abilities. I guess that'd be better if it didn't have the word often in it. focus on abilities though because yeah if you already have i feel good about my abilities right something like that so it's the same thing i don't want to have just like that okay i feel unworthy at times but i feel worthy be having the first one yeah there i have yeah okay there are times when I doubt whether I am a worthwhile person. Worthy again, no? Yeah, again, it's like self-doubt. I don't know. I think I feel like this isn't really adding anything. Okay, I often compare myself to others and feel like I don't measure up. Comparing to others versus your self-esteem? Yeah. I wish I could be more like other people. I think we're out of theme here comparing to others okay I feel like I do not have much to be proud of I'm proud of my achievements I think we had before once it's just like a negative yeah okay sometimes I think I'm no good at all that's pretty strong depression yeah depression yeah you know that definitely says what I was going to say I feel depressed now I know I feel all right I feel that I do not have much to be proud of we have similar before a part of myself or something I don't know okay I tend to doubt my responses is good enough. Goodness as what? Yeah. I think it's like, yeah, again, it's just like self-measurer. I'm not sure. I'm not sure. I'm not good enough to be different than mine good enough. Okay. I tend to feel dissatisfied with myself. It's pretty negative. Yeah, I feel like it's more like negative self -perception than general self-esteem. Okay. So I think we'll just, I like this one, but I think since it's the only negatively phrased item, we should probably just stick with positively phrased items. So we can see if we could rephrase this just as like, can we rephrase it? I don't know. Sometimes I think I'm no good at all. I feel unhappy. If we don't, if a positive self-esteem, they have to say positive. Otherwise, this is going to end up being reverse scored, right? So how could we rate? I mean, that would be the same as I feel like I'm a person of worth, right? I feel, yeah. I'm a good person. I feel I'm a good person. Oh, that's a good one. I'm a good human being. Make sure you say you're a human. That's funny. I'm a good human. Is that funny? Yeah, I think we're a good member of society. Oh, yeah, we could say that. Do you want a good human or a good member of society? Shelly, I love you, but I kind of like I'm a good human. He don't love me and I like mine better. George, Shelly. Okay. So I think we have a pretty good list. I think that was, you know, hopefully that was a good experience for you guys. I may end up putting a few more back in just because we did such a good job of eliminating that we only ended up with 13. And we may want to have a few more with that for internal consistency exercise to see if there's some we want to throw out. But overall, I think we have a good list in pretty strong direction. So, Aubrey, did you have a question before we wrap up? Oh, no, that was earlier. And then I just said it. I have a quick question. Sure. How many questions would be, like, how many should we have that would make a good amount? I don't know that there's a definitive answer to that but there are there are definitely instruments that I've used that only have 10 items that are good and strong now the thing about that is you can't really you usually don't have subscales so there are other items I mean other instruments that are like let's say 20 but they might have some subscales right so you might have four items that are assessing, you know, a certain type of self-esteem and another five items that are looking at a different type of self-esteem and another five items looking at a different type of self -esteem and so on. So if you only have like 10 items, you probably wouldn't have subscales, but it could still be a strong instrument. There's some great instruments that only have like tenant items. You know, so, and then, And like if you take look at something like depression, often those are quite long instruments, but then there's some, you know, there's like an instrument that just asks four questions, like three or four questions and can kind of get, you know, kind of some decent data. It's not as thorough, right? But it could still be a good measure. So some instruments will have like a short form and a long form. and if the short form is not that much worse in terms of, like, reliability and validity, that a lot of times people might want to use the shorter version because it can still give them some good information while not burdening people. I know in I.O. Psychology, there's a lot of people that use, like, either the personality assessment, like the Big Five or emotional intelligence, and both of those have. subscales and so they end up being quite long like maybe it's like 80 or a hundred items right it just kind of depends what you're measuring so thank you all right well thank you guys and hope you have a great night and i will see you in the classroom thank you very much thank you