I'm excited to finally talk about some pretty cool stuff I've been working on for the last few weeks.

🧵 We've enhanced #HeyGitHub (@code AI voice assistant by @GitHubNext) with some new conversational capabilities.

🧠 With that change, #HeyGitHub can now answer general questions related to software development, generate and edit code, and control the editor while seamlessly following the conversation and understanding its context.

#ArtificialIntelligence
#AI
#DeveloperTools
#GitHubNext

@maxd seen "Hey, GitHub!" :github: yet?

That adds voice control to VSCode, and lets you use CoPilot too. You can sign up to the tech preview:

https://githubnext.com/projects/hey-github/

Sorry to hear about your RSI, hope it eases up :blobcatheart:

#VSCode #CoPilot #GitHub #AssistiveTech #VoiceControl #HeyGitHub #a11y #Accessibility

Yo Albert @wunderalbert - W/o a public #API, non-GitHub #AI/#ML devs can’t integrate #GitHubCopilot & #HeyGitHub into #CoT, #RLHF, Model-Switching, Prompt-Selection/Sequencing, etc. research. E.g., LangChainAI is on 🔥. See integrations: https://langchain.readthedocs.io/en/latest/integrations.html, & repo: https://github.com/hwchase17/langchain). I urge you to discuss w/ Oege & other Next Hubbers. 🙏

OMGaia Albert @wunderalbert! Have you ✅d’out this paper? 😱👍👏 “MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning“ 🤓🔥 The LangChain folks have taken a 1st cut at this in their Agent subsystem. This is what we need for a role-based `CoT Dialoguer` Agent in #HeyGitHub. 😎
https://arxiv.org/pdf/2205.00445.pdf

Hi Albert @wunderalbert,

Why UI/UX framework support for #HeyGitHub voice-coding productivity boosting?

With decades of experience on dev teams of all kinds, I see three user profiles of interest:

1. On large-project enterprise teams, the UI/UK coder tends to be a junior non-engineer designer. These folks can use all the help they can get to contribute to the team.

2. On small consultant engagement-based teams or small entrepreneurial teams, the senior engineer types have to wear many hats. For them, writing UI/UX code is a distraction when they would prefer to work on the actual problem solution code.

3. A third type, which I think fits me, we are thought-leading POC prototypers who are expert at nothing but just need to get our ideas alive for others to see the potential of our concepts. 🤓

In all three scenarios, while the reasons vary, the value of boosting UI/UX developer productivity is clear.

Quick update Albert @wunderalbert - My Zoom with Oege is rescheduled to Thursday. So looking forward to this. ITMT, Harrison Chase and the LangChain contributors have been on 🔥 this past week! 😱👍 The addition of the Agents and Memory features seem perfect for exploring the ideas in my #HeyGitHub #Copilot articles. 🤓 LangChain docs: https://langchain.readthedocs.io/en/latest/

Yo Albert @wunderalbert - Per my ‘Thoughts on Agency’ #HeyGitHub article, the addition of #ConversationChain, #Agent, and #Memory features in #LangChainAI could be gr8 way to explore adding “Sherlockean smarts” into Conversational #Copilot focused on support for building apps based on popular UI/UX frameworks.
https://twitter.com/sjwhitmore/status/1596213155210096640?s=12&t=Khpgtpee1al2eccE5duSSw

Hey Jim!
@Jim_Salmons

Thanks for those kind words, I'm super happy to hear #HeyGitHub is making a difference!

I wasn't aware of your articles yet, they look super interesting! They're going right to the top of my reading list.

Give my best to Oege on Tuesday!

Hi Albert @wunderalbert 🤗 TY4Follow. The #HeyGitHub work you are doing w/ Rahul Pandita & the Nexters is so important to us #DisabledDevelopers & #DisabledSTEMstudents. Your expertise is precisely the knowledge I need to understand to pursue ideas I have written about in my last 3 articles at https://bit.ly/Copilot4DisDev. Most recent on Agency #CoT etc. https://bit.ly/agency-and-copilot. I am Zooming with Oege de Moor on Tuesday about this. Wish me luck. 🤞✌️

@spanichella & @wunderalbert - This workshop sounds beyond awesome!😍 I hope this whole sub-event, or at least Albert’s keynote, is among the hybrid sessions at #ICSE2023. Since #DisabledDevelopers and #DisabledSTEMstudents are a target user group for #HeyGitHub & other voice-coding #AssistiveTechnology, this topic is especially important to us. And unfortunately our various forms of disability can make travel and in-person events challenging.

Pédagogie spécialisée, le Journal est sorti de presse! https://paper.li/classeprepa/1332761307?edition_id=f83a1c80-69d2-11ed-9961-fa163e6ccaff Les unes d'aujourd'hui via @anaerevue@twitter.com @Jim_Salmons@twitter.com #disableddeveloper #heygithub

#Programming without even using your hands?

The future is now, and I'd ask to please share to every #developer who might benefit from reducing / eliminating the need to type:

https://githubnext.com/projects/hey-github

#HeyGitHub #hands #ai #VoiceRecognition

(Disclaimer: I'm part of the company, and indeed of the team, that built this.)

Super excited to finally introduce a new project we’ve been working on at @GitHubNext!

I’m so happy we can help people, who have troubles with using keyboard and mouse, to enjoy creating software.

#HeyGitHub

https://githubnext.com/projects/hey-github