Gdao v1.2.2：Go 语言高效 ORM 框架，缓存优化

10月26日，北京站源创会，聊聊高性能计算与大模型推理

gdao是一个全面的go持久层解决方案。主要目的在于减少编程量，提高生产力，提高性能，支持多数据源整合操作，支持数据读写分离，制定持久层编程规范。灵活运用 gdao，可以在持久层设计上，减少30%甚至50%以上的编程量，同时形成持久层的统一编程规范，减少持久层错误，同时易于维护和扩展。 gdao对于go语言，相当于 hibernate+ myBatis对于java语言

gdao完整地在go语言中实现 myBatis的核心功能，实现SQL与程序分离，实现强大的动态SQL功能

GitHub : Gdao Repository

示例程序: Gdaodemo

使用文档: Gdaodoc

同类型框架性能压测数据：《Gdao—orm框架性能压测 gdao+gorm+sqlx+原生sql执行》

Gdao 1.2.2 更新内容

新增写过期缓存

通过 BindExpireWriteClass 或 BindExpireWriteClassWithCacheHandle 设置写过期缓存，当设置的类发生写操作时，将自动清除缓存数据。

使用示例：

 func TestExpireWrite(t *testing.T) { 	gdaoCache.BindExpireWriteClass[dao.Hstest]() //set cache for Hstest 	hs := dao.NewHstest() 	hs.Where((hs.ID.Between(0, 2)).Or(hs.ID.Between(10, 15))) 	hs.Limit(3) 	hs.Selects() //第一次查询，缓冲池没有数据，则结果集放入缓冲池 	println() 	hs = dao.NewHstest() 	hs.Where((hs.ID.Between(0, 2)).Or(hs.ID.Between(10, 15))) 	hs.Limit(3) 	hss, _ := hs.Selects() //第二次查询，缓冲池有数据，返回缓存数据 	println() 	hss[0].Insert() //新增一条数据；发生增删改操作，清除dao.Hstest类的所有缓存 	println() 	hs = dao.NewHstest() 	hs.Where((hs.ID.Between(0, 2)).Or(hs.ID.Between(10, 15))) 	hs.Limit(3) 	hs.Selects() //第三次查询，缓冲池已经清空数据，结果集重新放入缓冲池 }

结果打印与解析

 === RUN   TestExpireWrite  //第一次查询，缓冲池没有数据，则结果集放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //第二次查询，缓冲池有数据，返回缓存数据 [GET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][GET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //新增一条数据；发生增删改操作，清除dao.Hstest类的所有缓存 [DEBUG][INSERT][insert  into hstest(updatetime,body,floa,level,id,age,rowname,value )values(?,?,?,?,?,?,?,?)][2024-06-21 00:00:00 +0800 CST [49 49 49 49 49 49] 1 22222222 1 33 111 bbbb]  //第三次查询，缓冲池已经清空数据，结果集重新放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]

实际项目使用示例：如 https://tlnet.top 项目，该项目使用gdao读写数据，并使用写过期缓存数据，方便数据缓存与增删改过期

设置相应的类的写过期缓存，当这些类发生增删改时，它们的缓存数据被清除

读取数据

不使用缓存，使用UseCache(false)

通过Gdao缓存， https://tlnet.top 的响应非常迅速，具备极高性能表现。

简单使用介绍

1. 安装

 go get github.com/donnie4w/gdao

2. 配置数据源

 gdao.Init(mysqldb,gdao.MYSQL) //gdao初始化数据源  mysqldb 为sql.DB对象 ， gdao.MYSQL 为数据库类型

3. 标准化结构体操作

 // 读取 hs := dao.NewHstest() hs.Where(hs.Id.EQ(10)) h, err := hs.Select(hs.Id, hs.Value, hs.Rowname) //[DEBUG][SELETE ONE][ select id,value,rowname from hstest where id=?][10]

 // 更新 hs := dao.NewHstest() hs.SetRowname("hello10") hs.Where(hs.Id.EQ(10)) hs.Update() //[DEBUG][UPDATE][update hstest set rowname=? where id=?][hello10 10]

 // 删除 hs := dao.NewHstest() hs.Where(hs.Id.EQ(10)) hs.Delete() //[DEBUG][UPDATE][delete from hstest where id=?][10]

 //新增 hs := dao.NewHstest() hs.SetValue("hello123") hs.SetLevel(12345) hs.SetBody([]byte("hello")) hs.SetRowname("hello1234") hs.SetUpdatetime(time.Now()) hs.Insert() //[DEBUG][INSERT][insert  into hstest(floa,age,value,level,body,rowname,updatetime )values(?,?,?,?,?)][hello123 12345 hello hello1234 2024-07-17 19:36:44]

4. 原生SQL操作

 //查询，返回单条 gdao是原生SQL操作入口 gdao.ExecuteQueryBean("select id,value,rowname from hstest where id=?", 10)  //insert gdao.ExecuteUpdate("insert into hstest2(rowname,value) values(?,?)", "helloWorld", "123456789");  //update gdao.ExecuteUpdate("update hstest set value=? where id=1", "hello");  //delete gdao.ExecuteUpdate("delete from hstest where id = ?", 1);

5. 配置缓存

 //绑定Hstest  启用缓存, 缓存默认时效为300秒, gdaoCache为缓存操作入口 gdaoCache.BindClass[dao.Hstest]()

6. 读写分离

 === RUN   TestExpireWrite  //第一次查询，缓冲池没有数据，则结果集放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //第二次查询，缓冲池有数据，返回缓存数据 [GET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][GET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //新增一条数据；发生增删改操作，清除dao.Hstest类的所有缓存 [DEBUG][INSERT][insert  into hstest(updatetime,body,floa,level,id,age,rowname,value )values(?,?,?,?,?,?,?,?)][2024-06-21 00:00:00 +0800 CST [49 49 49 49 49 49] 1 22222222 1 33 111 bbbb]  //第三次查询，缓冲池已经清空数据，结果集重新放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]0

7. SQL映射

 === RUN   TestExpireWrite  //第一次查询，缓冲池没有数据，则结果集放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //第二次查询，缓冲池有数据，返回缓存数据 [GET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][GET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //新增一条数据；发生增删改操作，清除dao.Hstest类的所有缓存 [DEBUG][INSERT][insert  into hstest(updatetime,body,floa,level,id,age,rowname,value )values(?,?,?,?,?,?,?,?)][2024-06-21 00:00:00 +0800 CST [49 49 49 49 49 49] 1 22222222 1 33 111 bbbb]  //第三次查询，缓冲池已经清空数据，结果集重新放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]1

 === RUN   TestExpireWrite  //第一次查询，缓冲池没有数据，则结果集放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //第二次查询，缓冲池有数据，返回缓存数据 [GET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][GET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //新增一条数据；发生增删改操作，清除dao.Hstest类的所有缓存 [DEBUG][INSERT][insert  into hstest(updatetime,body,floa,level,id,age,rowname,value )values(?,?,?,?,?,?,?,?)][2024-06-21 00:00:00 +0800 CST [49 49 49 49 49 49] 1 22222222 1 33 111 bbbb]  //第三次查询，缓冲池已经清空数据，结果集重新放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]2

8. 动态SQL映射

 === RUN   TestExpireWrite  //第一次查询，缓冲池没有数据，则结果集放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //第二次查询，缓冲池有数据，返回缓存数据 [GET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][GET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //新增一条数据；发生增删改操作，清除dao.Hstest类的所有缓存 [DEBUG][INSERT][insert  into hstest(updatetime,body,floa,level,id,age,rowname,value )values(?,?,?,?,?,?,?,?)][2024-06-21 00:00:00 +0800 CST [49 49 49 49 49 49] 1 22222222 1 33 111 bbbb]  //第三次查询，缓冲池已经清空数据，结果集重新放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]3

 === RUN   TestExpireWrite  //第一次查询，缓冲池没有数据，则结果集放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //第二次查询，缓冲池有数据，返回缓存数据 [GET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][GET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //新增一条数据；发生增删改操作，清除dao.Hstest类的所有缓存 [DEBUG][INSERT][insert  into hstest(updatetime,body,floa,level,id,age,rowname,value )values(?,?,?,?,?,?,?,?)][2024-06-21 00:00:00 +0800 CST [49 49 49 49 49 49] 1 22222222 1 33 111 bbbb]  //第三次查询，缓冲池已经清空数据，结果集重新放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]4

9. SqlBuilder

 === RUN   TestExpireWrite  //第一次查询，缓冲池没有数据，则结果集放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //第二次查询，缓冲池有数据，返回缓存数据 [GET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][GET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //新增一条数据；发生增删改操作，清除dao.Hstest类的所有缓存 [DEBUG][INSERT][insert  into hstest(updatetime,body,floa,level,id,age,rowname,value )values(?,?,?,?,?,?,?,?)][2024-06-21 00:00:00 +0800 CST [49 49 49 49 49 49] 1 22222222 1 33 111 bbbb]  //第三次查询，缓冲池已经清空数据，结果集重新放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]5

10. SqlBuilder

 === RUN   TestExpireWrite  //第一次查询，缓冲池没有数据，则结果集放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //第二次查询，缓冲池有数据，返回缓存数据 [GET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][GET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //新增一条数据；发生增删改操作，清除dao.Hstest类的所有缓存 [DEBUG][INSERT][insert  into hstest(updatetime,body,floa,level,id,age,rowname,value )values(?,?,?,?,?,?,?,?)][2024-06-21 00:00:00 +0800 CST [49 49 49 49 49 49] 1 22222222 1 33 111 bbbb]  //第三次查询，缓冲池已经清空数据，结果集重新放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]6

11. SqlBuilder 动态SQL

 === RUN   TestExpireWrite  //第一次查询，缓冲池没有数据，则结果集放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //第二次查询，缓冲池有数据，返回缓存数据 [GET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][GET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]  //新增一条数据；发生增删改操作，清除dao.Hstest类的所有缓存 [DEBUG][INSERT][insert  into hstest(updatetime,body,floa,level,id,age,rowname,value )values(?,?,?,?,?,?,?,?)][2024-06-21 00:00:00 +0800 CST [49 49 49 49 49 49] 1 22222222 1 33 111 bbbb]  //第三次查询，缓冲池已经清空数据，结果集重新放入缓冲池 [SET CACHE] [DEBUG][SELETE LIST][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3] [DEBUG][SET CACHE][ select id,age,rowname,value,updatetime,body,floa,level from hstest where id between ? and ? or (id between ? and ?) LIMIT ? OFFSET 0 ][0 2 10 15 3]7

宙飒天下网