Speed Up Your AI Development Workflow by 2x

Speed Up Your AI Development Workflow by 2x

Nick Chapsas

0:00 Hello everybody, I'm Nick and in this

0:01 video I want to talk about how I double

0:02 my productivity of my development

0:04 workflow by utilizing a couple of

0:06 applications that really speed up what I

0:09 think is my bottleneck and I'm sure it's

0:11 the bottleneck for many of you and it's

0:14 mainly related to typing now because we

0:17 no longer go into an application and we

0:20 just start typing everything manually

0:22 like you'll still do that but a lot of

0:24 that has now been dominated by AI.

0:27 I want to see how I can improve my words

0:30 per minute and I can type fairly fast.

0:33 Not super fast.

0:34 I can do 100 words per

0:35 minute pretty consistently, but in code

0:38 with autocomplete and so on, things slow

0:40 you down more than you think.

0:42 It's not like you're typing down an essay.

0:44 So that word per minute is actually reduced

0:46 quite a bit.

0:47 Now going back into an AI

0:49 agent like clo for example, you wouldn't

0:52 write code here.

0:52 You might paste code,

0:54 but you would write what you want the

0:56 tool to do.

0:57 So for that reason I looked

0:59 into solutions to how I can solve it and

1:02 I found two things.

1:03 First sometimes I just want to type down my thoughts and I

1:07 can go ahead and say in this demo which

1:09 is part of the demo for my online

1:12 workshop I'm running in in 7 days.

1:14 If you want to join there's a few links in

1:16 the description you can check that out.

1:17 I'm going to teach you how to do Vibe

1:19 coding for production at proper proper

1:22 scale.

1:23 something you can actually push

1:24 to production to customers and be secure

1:27 and safe about it.

1:27 And as part of that

1:28 workshop, I'm showing hey, here's an

1:30 application uh and ignore the text being

1:32 small.

1:33 The code doesn't really matter,

1:34 but this application has a few

1:35 vulnerabilities I want to showcase and I

1:37 want to show how AI can sort of fix that

1:40 by auditing it and then suggesting what

1:42 we should do about it.

1:44 Now, I can go

1:45 here and manually type, please go ahead

1:48 and run a security audit for my code.

1:51 However, can I speed that up?

1:53 And the answer is yes.

1:53 And I can do it in two

1:55 ways.

1:55 The first one is with autocomplete

1:58 and not stupid autocomplete that tries

2:02 to hallucinate things based on no

2:04 context or minimal context, but actually

2:07 take a look at what's going on in the

2:09 screen and what I'm typing, process

2:11 that, and then start suggesting things

2:13 based on that.

2:14 So for example, if I now

2:16 start typing please run, you can

2:20 actually see text is appearing.

2:21 It's small because the scaling doesn't work

2:24 well in this big screen.

2:25 When it is smaller, it works fine.

2:27 But if you notice here, it says please run the

2:30 following command.

2:31 It's suggesting.

2:32 And if I was to press tab, it will go ahead

2:35 and accept this word as something I

2:37 typed.

2:38 But I want to say please run a

2:41 and it suggest code analysis.

2:43 If I say S, it's going to say security check on

2:46 the code.

2:46 And I can press tab tab tub

2:48 tab tab tab.

2:50 And it says below.

2:51 I don't want to do it in the in the code below.

2:53 I want to do it in the code of this

2:55 codebase.

2:56 So please run security check

2:57 on the code of this project.

3:01 And I can just accept it and it automp completes

3:03 the words using the context.

3:05 Now how is that happening?

3:07 It must be some LLM

3:08 involved.

3:09 And and the answer is yes,

3:10 there is.

3:10 However, I'm not the biggest

3:12 fan of LLMs seeing what I do on my

3:15 screen and then sending it into some

3:18 server for processing.

3:19 So, all of this

3:20 is actually running locally and I'm

3:23 achieving that with an application

3:25 called co- typist.

3:27 So, cotypist is this

3:29 app over here which I'm sorry it is

3:31 small.

3:31 I'm going to zoom in a bit.

3:33 But Cotypus is an app I'm running on my Mac

3:35 which as you can see is using GMA4E4B

3:40 which is a local LLM.

3:42 At no point is a

3:44 request sent to the server for

3:45 processing.

3:46 All of this is happening

3:47 locally on my machine and I can choose

3:49 how much context I want to give it.

3:52 I can give it some information.

3:53 So I can personalize it.

3:54 For example, I've said a

3:56 few things about me.

3:57 For example, I'm Nick Jobs says I usually write in

3:59 English.

4:00 Please write in a friendly and

4:01 casual tone and so on.

4:02 And you can customize the custom AI instructions.

4:06 And then you can choose tons of things.

4:08 For example, don't use emojis on

4:10 whatever you're writing because they're

4:11 cringe or how much context.

4:13 Hey, use screenshots for context.

4:16 Do not use the

4:17 clipboard for context.

4:18 And it will take

4:20 screenshots and as I'm typing, it will

4:22 look at the context of my screen and

4:24 then do all that processing offline.

4:27 At no point does it go in OpenAI or Google

4:30 or any other service which I feel very

4:33 comfortable about because it's all local

4:35 here and then it will use that to

4:38 suggest things on everything.

4:39 It's not just for coding.

4:40 If I write an email,

4:41 this will kick in.

4:42 This will basically kick in everywhere.

4:45 When I'm on notion

4:45 and working on some notes, it will do

4:47 it.

4:47 When I'm writing a message on

4:49 WhatsApp, it will do it.

4:50 And again, all of this is local and you can choose the

4:54 model.

4:55 So, you don't have to use GMA 4.

4:57 It gives you a few suggestions on other

4:59 models that are working depending on how

5:01 good your machine is and how much RAM

5:03 you have.

5:04 You can choose to have a

5:05 bigger model.

5:05 Of course, a bigger model

5:06 means that it might be slower, but my

5:10 machine is fine.

5:10 I have half a terabyte

5:12 of RAM, so I'm way more than comfortable

5:15 with using something like this and not

5:16 stressing the system.

5:18 And I have found

5:19 that this significantly speeds up not

5:22 just my coding workflow, but sort of any

5:24 other workflow I have where I need to

5:26 type because the context is so good.

5:28 It understands what's going on.

5:30 And this doesn't just work at the terminal.

5:32 It can work anywhere.

5:33 I mean, you can limit

5:34 it.

5:35 So you can go all the way here to

5:37 app settings and say don't work on

5:40 rider, don't work on IntelligJ because

5:42 those things have their own autocomplete

5:44 usually.

5:44 So you can exclude a few things

5:46 that you don't want the thing to kick

5:48 into.

5:49 And you can also do the same for

5:50 domains.

5:51 So if you want to exclude a

5:52 specific domain, maybe your banking

5:53 domain and so on, it will know and it

5:56 won't go ahead and do anything there.

5:58 Now again, this is still fine because

6:00 all of this is local.

6:01 How do I know it's

6:02 local?

6:02 Well, first the model is local.

6:04 But to make sure that it absolutely

6:07 doesn't send anything over the wire, I

6:09 also have radio silence installed which

6:11 allows me to block certain applications

6:14 from ever calling the web.

6:15 So for example, as you can see here, codeist is

6:18 blocked.

6:18 It can't go over the web and

6:20 send requests.

6:21 You can actually go to

6:22 network monitor and guarantee that

6:25 nothing will go to the cloud on any

6:27 other server.

6:28 So this is the first part.

6:31 The second part is that look, I'm

6:34 working in an office alone.

6:36 Why do I have to type all the time?

6:38 And the answer is I don't.

6:39 Usually now what I do

6:41 is I dictate.

6:42 So I talk to my

6:43 microphone.

6:44 And in fact, I have a small

6:46 microphone over here which I always have

6:48 on my desk separated from this because I

6:50 don't want to have this in front of me

6:52 all the time.

6:53 And this can now pick up

6:54 exactly what I'm saying by me just

6:57 pressing caps lock holding it down and

7:00 space.

7:01 I'm using hyper key which is a

7:02 utility on Mac to do that.

7:04 It gives you a more flexible way to do key bindings.

7:07 And if I go and click it, you'll see a

7:08 window pop up at the bottom and it will

7:10 start writing down what I'm saying.

7:13 So just like that.

7:15 And if I just delete

7:16 it, if I show you how the workflow would

7:18 be and and you saw how fast it is, then

7:20 I can simply say run a security audit

7:23 for this application.

7:24 That's it.

7:26 And it's there.

7:27 This significantly speeds up

7:28 my workflow.

7:29 Of course, I can't talk

7:30 every time if it's late.

7:31 I don't want to

7:32 be whispering, please run a security

7:34 workflow for this application, and so

7:35 on.

7:36 But when I'm here and it's the day,

7:38 I want to do that.

7:39 And it's here and

7:40 it's super fast.

7:42 And in the same nature

7:43 as code typist this is using an

7:44 application called typew whisper.

7:46 Now with type whisper again this is a local

7:50 thing that as you could see before in

7:53 radio silence it cannot actually access

7:56 the web everything is here local and

7:58 secure.

7:59 And if I go back I accidentally

8:01 closed it.

8:02 If I go back you'll see that

8:04 I have chosen over here uh a default

8:08 engine.

8:08 I'm using Power Kit because I

8:09 found this is the fastest and most

8:12 accurate engine for this specific uh

8:14 solution I have.

8:15 But Whisper Kit is

8:16 pretty good as well.

8:17 It's just a bit

8:18 slower.

8:18 And then you can choose the

8:19 model.

8:19 Those are local models which you

8:21 can go over here on integrations and

8:25 install.

8:25 So I have Whisper Kit

8:27 installed.

8:27 I have Parit installed.

8:28 I have Apple speech as well which is

8:30 extremely fast but not that accurate and

8:33 contextually intelligent.

8:35 And I can also

8:36 have local file memory so I can remember

8:37 a few of the things I've said to use

8:39 them as context.

8:40 I can also have

8:42 snippets for example when I want a

8:43 hyphen to be converted into something

8:45 else.

8:46 And I can go here and say Nick

8:47 hyphen chops and it will chops

8:52 and we'll go here and replace hyphen

8:54 with that instead of actually typing the

8:56 word hyphen.

8:57 I'm doing the same with

8:58 things like front end design which is a

9:00 skill you would use in cloud or cursor

9:03 and so on.

9:03 You can have your own

9:04 dictionary.

9:05 You can customize everything

9:06 about this.

9:06 You can have file

9:08 transcripts.

9:08 You can have custom

9:10 hotkeys.

9:10 As you can see, I'm using this

9:12 very elaborate one, but these four ones

9:14 are actually just holding down the caps

9:15 lock button.

9:16 And you can customize

9:18 everything about it.

9:19 And again, this is

9:20 appaware.

9:21 So, it can actually

9:22 understand, hey, I'm in an editor.

9:24 I'm in a in a terminal.

9:25 I'm I'm somewhere.

9:26 And it will adapt what I'm writing to

9:29 whatever it can hear.

9:30 So if I want to be

9:31 a bit more elaborate, I can say very

9:33 quickly and that's impressive about it.

9:35 It's actually very very snappy.

9:37 I can say please run security audit about this

9:40 application.

9:40 Make sure that SQL

9:42 injection is not possible with this

9:43 application and also check for any HTTP

9:46 related vulnerabilities that might be

9:48 affecting an application like this.

9:50 So I'm speaking in my very normal voice and

9:53 it's typing way faster than I could

9:56 possibly write this.

9:57 If I try to write

9:58 this, I mean, it's not going to.

10:01 Okay, this is actually reading the

10:03 context and it's going ahead and it's

10:04 typing it with code typist, but as you

10:08 can see, it still isn't as fast as the

10:11 local LLM using my voice.

10:13 It's lovely.

10:14 It is amazing.

10:15 I know tons of you are on

10:17 Macs, and I'm certain there's

10:18 alternatives for this on Windows, but

10:20 I'm not using Windows for development,

10:22 so I I can't possibly know.

10:24 But as you can see, this can significantly speed up

10:28 your workflow.

10:29 I'm hitting 150 to 160

10:32 words per minute when I'm dictating with

10:34 my normal voice.

10:35 And this does not have

10:36 to go to the cloud, involve that

10:38 latency, and involve your recording

10:40 going somewhere, which I think is

10:42 lovely.

10:43 But now I want to know from you,

10:44 do you use any tools like this to speed

10:47 up your workflow?

10:48 Leave a comment down

10:48 below and let me know.

10:49 Well, that's all I had for you for this video.

10:51 Thank you very much for watching.

10:52 As always, keep coding.

10:54 dictating.

Study with Looplines Download Captions Watch on YouTube