Mike FrenetteManager, IT PMO| Halifax Water (retired)Halifax, Nova Scotia, Canada
Many generative AI products will take your input and apply it to what it finds in its data lake, then generate something that will save you time and effort. But will it be accurate? Will it be unbiased? Will it be the same as you would have written? How do you feel about that? Is it ethical? If so, how do you make it our own? Saving Changes...
Adam RussellPrincipal Consultant (Project Management)| Tiligent Pty LtdPutney, New South Wales, Australia
One follow-up on the OP: GPT does not have a "data lake" in any sense that it stores data that is or resembles the original training data. All it stores are probabilities and tokens, completely disaggregated from the original content units. I don't want to be a nit-picker, but it is a fundamental aspect of the LLM architecture that is easily misunderstood, which drives misconceptions about the nature of human-AI interaction. When we cause ChatGPT to generate output, it does not retrieve a block of pre-written text (e.g., a fragment from Wikipedia) or even "assemble" the response from multiple fragments of recognisable content. It "assembles" the response at the "word" level, based on the input and vast numbers of probability parameters. This aspect of the LLM architecture removes consideration of factors such as citing the original source of the material or plagiarisation (except perhaps in the strict academic sense of the word). There is no single source from which the content is generated. In one way it's an extremely simple concept but the implementation is mind-boggling in scope, complexity and resource requirements.
This is relevant to the OP because we shouldn't interpret what ChatGPT generates in the same way as any other form or method of using someone else's work. It can be much much worse or better, depending on the use case.
Saving Changes...
George FreemanThought Leader | Author | Architect| Florida, United States
May 18, 2024 4:48 PM
Replying to Adam Russell
...
There are no arbitrary measurements that would give us objective answers to this. When we look at a painting by Rembrandt or Michelangelo, do we think any less of the artwork if we learn that they both employed many assistants for jobs ranging from mixing paint to painting in sections of the work? When we use a grammar checker like Grammarly or Pro-Writing Aid to rewrite sentences and paragraphs for clarity and better grammar, does that mean it isn't our work anymore? If we let MS Project calculate our complex dependencies and the resulting dates, are we less of a project manager? Why are these things apparently ok, but using ChatGPT (or other GenAI products) is not? Obviously, it's a matter of degree. ChatGPT is useful to a project manager in many ways that do not compromise the work's authenticity and produce a better result. It's very easy to cite ChatGPT as a contributor or source; a link in the main ChatGPT window will give you a citation. But as long as it is treated as a bad thing and blanket policies ban its use, people will be reluctant to surface its use, even if it is legitimate.
Key Questions:
1. Who has control over the content? Who has the final say?
2. Who originates the ideas?
3. Who edits and reviews?
4. What is the proportion of AI vs Human contribution to a final work?
5. What level of mastery does the human have in a topic vs the AI?
6. Is ChatGPT a source of information (facts etc), a source of text to reword, amplify or reduce author's text or an editorial tool?
If I generate the primary content/central idea for the content, I have strong competency in project management, and the level of AI content in the final product is relatively low because I've reviewed and edited it to fit my overall purpose, then I don't see any reason to cite ChatGPT any more than I would acknowledge using a grammar checker and an online encyclopedia.
One last use case: if I update a project schedule and paste an image or data to ChatGPT to analyse the differences between this one and the previous one, which I then check for accuracy and edit for my project report, do you think ChatGPT should be cited as a contributor?
Adam,
To further my thoughts on this subject, I created the following oversimplified definition of GenAI:
- A “tool” that interrogates knowledge (veracity unknown) provided by language models and/or a user and generates solutions or structured content as “directed by and in response to” promptings made by a user.
I state the definition, not to you specifically, but to make the point that GenAI is just a tool. As such, I agree with you that any ethical concerns that apply to GenAI also apply to other tools we use in our personal and professional lives.
However, GenAI supercharges the ability to cross ethical lines, hence this conversation/topic.
What are those lines? Here’s what comes to my mind:
[1] When one generates content implied or portrayed as original but constitutes work patterned from others.
[2] When one generates content implied or portrayed as original, but said content exists beyond one’s current domain knowledge or creative capabilities.
[3] When one generates plagiaristic content.
My greater concern with GenAI is the societal consequences of “Epistemic Erosion.” Specifically, the [1] dilution of knowledge and the [2] obfuscation of, or ability to determine truth.
George Saving Changes...
Adam RussellPrincipal Consultant (Project Management)| Tiligent Pty LtdPutney, New South Wales, Australia
May 18, 2024 11:14 AM
Replying to George Freeman
...
Adam,
Regarding your proposition: “The use of Grammarly AI…How much did AI contribute…Could the user have created the content if given the time?”
To adequately address the ethical considerations in Mike’s question and your well-stated thoughts, we should first understand the context of “Artificial Intelligence” when used in products and services (not all, but most).
Consider the following:
-------------------------
[1-Question]: What does AI functionally mean when referring to AI in the context of ChatGPT, Co-Pilot, Grammarly AI, and others?
[1-Answer]: An application/device purposed to perform a scope of tasks that typically requires a human. Although a functionally correct definition, it implies a stark reality that most consumers do not understand or appreciate.
[2-Question]: If the above definition is correct, is it reasonable to postulate that companies leverage marketing hyperbole to sell products and services through the user of the term AI?
[2-Answer]: Yes. For instance:
[2-Answer-A]: Microsoft has a fantastic OCR-API that I’ve used, and just a few years ago, it was in a framework called “Computer Vision Image Analysis,” then it changed to “Cognitive Services,” and is now “AI Services.” This morphing of product and service names has happened everywhere, including software that supports the project management industry.
[2-Answer-B]: twenty-five years ago, in my research, I used a library/API called “Link Grammar,” initially launched in the early 1990s. It’s a theory of syntax that has influenced grammar checkers and language models over four decades. For instance, it was used in the “OpenCog AI Project” as a critical element in their NLP pipeline and has influenced what we now recognize as GenAI—Is this theory-based foundational element worthy of an “AI” tagline, or is it just a well designed, hardwon framework that empowered or influenced the language models we see in use today?
-------------------------
So, although we have essential ethical questions to resolve in society and our profession related to using GenAI, would these questions be “knocking at our door” if “AI” was not used in its description?—I’m not sure of the answer.
I do know that the ethical constructs we create in the future need to be aware of the above context and hyperbole’s role in this matter. Otherwise, these new constructs’ “staying power” and their impact on industry and society may be left wanting.
-------------------------
Specifically to the use of “Grammarly AI:”
From my perspective, this is simply a grammar checker that has evolved in its features and functions over time and would have done so regardless of so-called AI technology. Of course, I must disclose that I used the full suite of Grammarly products; hence, I may be protecting my position on this one. :-)
George
Hi George, you've made some excellent points and I tend to agree with them. You're definitely right about the AI marketplace: everything is being "AI-enabled" at the moment, either in functionality or in branding. This in itself is a factor for content creators and professional workers in that the options to *not* use AI are narrowing fast. Your question: "Could the user have created the content if given the time?” is absolutely on point - it's a great question because it's a proxy for many others.
(On a side note, I've been in the IT/PM industry for over 4 decades and it's been alarming and amusing to see how corporate (or even internal) presentations get reworked to include every new fad that comes along. Global replace "Hosting" with "Cloud" for example, and many more.)
My problem with self-disclosure is that it's not an objective environment. I'm very happy to self-assess my use and decide whether i need to disclose, in the event that I did use ChatGPT in the product of my work. The questions being asked by people, platforms, educational institutions and more are far too crude to capture the nuances of these posts, and the downside is too large to engage in the questions literally.
Interestingly, I just finished some research for my Masters in PM (on the use and attitudes of ChatGPT and Project Management practitioners) - in the questions on employer awareness and attitude there was very much a "laissez-fair" majority who didn't know and/or didn't encourage or discourage its use.
This is not the same in platforms such as Amazon KDP, and more. Everyone is asking effectively "has AI touched this at all"m with the risk of being banned or rejected if the answer is yes. I understand the concerns about being swamped with "book spam"
I've developed some tools for self assessment (can't post the images here) but I'll post a link once I've finished the posts.
...
1 reply by George Freeman
May 19, 2024 8:37 AM
George Freeman
...
It would be interesting to compare our experiences, as I am also in my fourth decade in the IT/PM industry (43 years)—As we know, there’s a story and a lesson learned behind every gray hair :-)
Saving Changes...
George FreemanThought Leader | Author | Architect| Florida, United States
May 19, 2024 3:54 AM
Replying to Adam Russell
...
Hi George, you've made some excellent points and I tend to agree with them. You're definitely right about the AI marketplace: everything is being "AI-enabled" at the moment, either in functionality or in branding. This in itself is a factor for content creators and professional workers in that the options to *not* use AI are narrowing fast. Your question: "Could the user have created the content if given the time?” is absolutely on point - it's a great question because it's a proxy for many others.
(On a side note, I've been in the IT/PM industry for over 4 decades and it's been alarming and amusing to see how corporate (or even internal) presentations get reworked to include every new fad that comes along. Global replace "Hosting" with "Cloud" for example, and many more.)
My problem with self-disclosure is that it's not an objective environment. I'm very happy to self-assess my use and decide whether i need to disclose, in the event that I did use ChatGPT in the product of my work. The questions being asked by people, platforms, educational institutions and more are far too crude to capture the nuances of these posts, and the downside is too large to engage in the questions literally.
Interestingly, I just finished some research for my Masters in PM (on the use and attitudes of ChatGPT and Project Management practitioners) - in the questions on employer awareness and attitude there was very much a "laissez-fair" majority who didn't know and/or didn't encourage or discourage its use.
This is not the same in platforms such as Amazon KDP, and more. Everyone is asking effectively "has AI touched this at all"m with the risk of being banned or rejected if the answer is yes. I understand the concerns about being swamped with "book spam"
I've developed some tools for self assessment (can't post the images here) but I'll post a link once I've finished the posts.
It would be interesting to compare our experiences, as I am also in my fourth decade in the IT/PM industry (43 years)—As we know, there’s a story and a lesson learned behind every gray hair :-)
...
1 reply by Adam Russell
May 19, 2024 4:26 PM
Adam Russell
...
I agree with the grey hair/wisdom metric for sure. Ignoring hubris, I did some extended calculations on my career a few years back and wrote it up on LinkedIn with a link at the bottom to a part 2 with more funky charts. I updated this last year on Medium. Links below:
I think it means simply that I've had more "Edison Moments" (found more ways not to run projects) than most other folks
Saving Changes...
Mike FrenetteManager, IT PMO| Halifax Water (retired)Halifax, Nova Scotia, Canada
Well, George and Adam, I think I will refrain from the "decades in the IT industry" discussion, other than to say that have some difficulty deciding whether I am even in the IT industry or the project management industry. So counting the decades in each becomes a fuzzy exercise when trying to determine overlap and where one begins and the other ends. Indeed, some of the most enjoyable projects I managed had far more to do with policy, process and the management of change than with IT.
Thanks for your contributions to this discussion on the ethics of Gen AI. Even since I began the discussion only few months ago, things have changed.
Speaking of existing products that have been around for years claiming to suddenly be AI-based, it occurs to me that as we are comparing GenAI products to tools like Grammarly, spreadsheets, project scheduling tools and the like, we are perhaps missing a glaring difference - most of these other tools are based on rules, or bodies of accepted knowledge.
There are rules of grammar, rules of mathematics, rules of critical path calculations and so on. So it becomes far easier to recognize questionable answers, or to prove a tool is producing an inaccurate result should we feel the need to assess it.
But most of these pre-AI tools are almost always right.
Is GenAI based on rules? I think we can all agree that it is not, or at least only to the extent that some of what it was "taught" might have been rule-based. So, it is often very difficult to determine whether the result of a GenAI query is right, wrong, or somewhere in between.
No rules.
Nothing to do with Eurovision, by the way. ;)
...
1 reply by Adam Russell
May 19, 2024 4:57 PM
Adam Russell
...
Hi Mike, thanks for kicking off this thread. And, at least from where I sit, much of that past is fuzzy :-)
On the AI thing, absolutely agree that the current AI products are humungously different to previous tools and that there are no rules. Even the history of AI has limited guidance: Ethan Mollick in HBR called the release of ChatGPT the "tipping point" for AI, which changed all the rules of AI application (vast pre-training, frictionless access and generic human-AI interaction, which neither constrains nor informs the user of underlying functionality). That's the reason there's so much noise. I think most users would be better off treating ChatGPT as a "black box" beyond a few heuristics on strengths and weaknesses. Users should treat the outputs on their merits rather than investing both the tool and the results with some sort of aspirational (magical) capabilities.
When there are no defined rules, we need to look to our own rules and principles to guide us.
Leaving aside the long history of content creators using assistants, tools and muses (the acknowledgement of which seems to be at the discretion of the creator), I view my prompts in the same way a developer views code: it is my skill and knowledge that is driving a tool to perform certain actions. Not perfect but it will do me for now.
I think it was George Freeman who posed the benchmark question: "Could the author have produced the work unaided, given time (or other resources)?"
So, as a basic rule, as long as I am driving it and it's not driving me, then I don't think it's anyone's business how I produce my works. I maintain my right to acknowledge the support I've had in any way I decide. That means I take full accountability for the works, including any errors (which is the usual formula for authors crediting their assistants) and will accept the bouquets or brickbats that come as a result. There are no "the AI got it wrong" or "the AI ate my homework" excuses.
As I said earlier, if the landscape for disclosure evolves to be more nuanced and less prejudicial, then my view on disclosure will evolve too.
Saving Changes...
Adam RussellPrincipal Consultant (Project Management)| Tiligent Pty LtdPutney, New South Wales, Australia
May 19, 2024 8:37 AM
Replying to George Freeman
...
It would be interesting to compare our experiences, as I am also in my fourth decade in the IT/PM industry (43 years)—As we know, there’s a story and a lesson learned behind every gray hair :-)
I agree with the grey hair/wisdom metric for sure. Ignoring hubris, I did some extended calculations on my career a few years back and wrote it up on LinkedIn with a link at the bottom to a part 2 with more funky charts. I updated this last year on Medium. Links below:
I think it means simply that I've had more "Edison Moments" (found more ways not to run projects) than most other folks
Saving Changes...
Adam RussellPrincipal Consultant (Project Management)| Tiligent Pty LtdPutney, New South Wales, Australia
May 19, 2024 10:40 AM
Replying to Mike Frenette
...
Well, George and Adam, I think I will refrain from the "decades in the IT industry" discussion, other than to say that have some difficulty deciding whether I am even in the IT industry or the project management industry. So counting the decades in each becomes a fuzzy exercise when trying to determine overlap and where one begins and the other ends. Indeed, some of the most enjoyable projects I managed had far more to do with policy, process and the management of change than with IT.
Thanks for your contributions to this discussion on the ethics of Gen AI. Even since I began the discussion only few months ago, things have changed.
Speaking of existing products that have been around for years claiming to suddenly be AI-based, it occurs to me that as we are comparing GenAI products to tools like Grammarly, spreadsheets, project scheduling tools and the like, we are perhaps missing a glaring difference - most of these other tools are based on rules, or bodies of accepted knowledge.
There are rules of grammar, rules of mathematics, rules of critical path calculations and so on. So it becomes far easier to recognize questionable answers, or to prove a tool is producing an inaccurate result should we feel the need to assess it.
But most of these pre-AI tools are almost always right.
Is GenAI based on rules? I think we can all agree that it is not, or at least only to the extent that some of what it was "taught" might have been rule-based. So, it is often very difficult to determine whether the result of a GenAI query is right, wrong, or somewhere in between.
No rules.
Nothing to do with Eurovision, by the way. ;)
Hi Mike, thanks for kicking off this thread. And, at least from where I sit, much of that past is fuzzy :-)
On the AI thing, absolutely agree that the current AI products are humungously different to previous tools and that there are no rules. Even the history of AI has limited guidance: Ethan Mollick in HBR called the release of ChatGPT the "tipping point" for AI, which changed all the rules of AI application (vast pre-training, frictionless access and generic human-AI interaction, which neither constrains nor informs the user of underlying functionality). That's the reason there's so much noise. I think most users would be better off treating ChatGPT as a "black box" beyond a few heuristics on strengths and weaknesses. Users should treat the outputs on their merits rather than investing both the tool and the results with some sort of aspirational (magical) capabilities.
When there are no defined rules, we need to look to our own rules and principles to guide us.
Leaving aside the long history of content creators using assistants, tools and muses (the acknowledgement of which seems to be at the discretion of the creator), I view my prompts in the same way a developer views code: it is my skill and knowledge that is driving a tool to perform certain actions. Not perfect but it will do me for now.
I think it was George Freeman who posed the benchmark question: "Could the author have produced the work unaided, given time (or other resources)?"
So, as a basic rule, as long as I am driving it and it's not driving me, then I don't think it's anyone's business how I produce my works. I maintain my right to acknowledge the support I've had in any way I decide. That means I take full accountability for the works, including any errors (which is the usual formula for authors crediting their assistants) and will accept the bouquets or brickbats that come as a result. There are no "the AI got it wrong" or "the AI ate my homework" excuses.
As I said earlier, if the landscape for disclosure evolves to be more nuanced and less prejudicial, then my view on disclosure will evolve too.
Saving Changes...
Graham SutherlandExecutive Director| Project Delivery Assurance ServicesSingapore, Australia
Hi Mike,
I'm new to the discussion boards but have been a long-time PMI member since 2008! I've become a huge fan of GenAI over the last year and it's transformed how I work. I mainly use Gemini Advanced to refine my work and get fresh ideas. My prompting skills have come a long way and the results are now impressive (though fact-checking is a must, as it's not perfect).
Here's my take on the pros and cons:
Pros:
- Speed and Efficiency: Significantly faster content creation. - Creative Spark: Generates new ideas and approaches. - Versatility: Applicable to writing, design, coding, and more.
Cons:
- Accuracy: Output quality varies, not always reliable. - Bias: Can unintentionally perpetuate biases from training data. - Originality: Lacks true creativity, mostly mimics existing styles.
- Transparency: Disclose AI use in your work. - Attribution: Give credit where due. - Licensing: Be mindful of restrictions. - Human Oversight: Always review and edit AI output.
Overall, GenAI is incredibly powerful, but responsible use is key. By understanding its limitations and ethical implications, we can leverage it to boost our productivity and creativity. Any detractors of AI are merely going to have to adapt; it truly is the future that businesses are embracing.
It's essential to consider transparency, accountability, and the integrity of the final deliverables when using AI in project management. However, relying solely on AI for critical project decisions may lack human oversight and understanding, raising concerns about accountability and quality assurance. Saving Changes...
I don't think it's a question of ethics. We have wonderful tools that help solve complex problems and save a lot of time. We should definitely use them. However, the issue arises when we blindly follow their output. As responsible project managers, we must always verify the results and apply logical analysis.