Those whose acquaintance with scientific research is derived chiefly from its practical results easily develop a completely false notion of the mentality of the men who, surrounded by a skeptical world, have shown the way to kindred spirits scattered wide through the world and through the centuries. Only one who has devoted his life to […]
Author: smith
On Finding Principles for Building Agents with Their Own Goals and Purposes
The rapid advancement of large language models (LLMs) has once again validated the bitter lesson: General methods that leverage computation ultimately outperform alternatives—by a large margin. This superiority becomes increasingly evident as more computation becomes available. General methods scale effectively with more data, computation, and memory, whereas alternative approaches often struggle due to their reliance […]
Notes on Compute Canada
File management best practices "As far as possible, use scratch and local storage for temporary files." The local storage on the could be accessed at $SLURM_TMPDIR. Try to avoid parallel write access to a file stored on a shared filesystem. But there is way out. Check the official documentation for more details.
The lesson from “The Bitter Lesson”
Rich Sutton’s note "The Bitter Lesson" is often quoted by others. The most frequently quoted sentence is the following: The biggest lesson that can be read from 70 years of AI research is that general methods that leverage computation are ultimately the most effective, and by a large margin. Based on such a statement, a […]
[Python] Tensorflow problems
Installation Problems Problem: installation failed using pip, got ImportError: /lib64/libm.so.6: version `GLIBC_2.23' not found (required by /home/xsx/.conda/envs/tensorflow/lib/python3.7/site-packages/tensorflow/python/_pywrap_tensorflow_internal.so) Solution: install using conda. conda create -n tfgpu python=3.6.8 tensorflow=1.13.1 Reference: Github Issue.
[ubuntu] ubuntu安装packages问题
apt-get安装packages 使用ubuntu,apt-get(or newer apt)是系统自带的包管理软件。在安装或者更新软件之前,我们通常执行sudo apt-get update来更新apt-get能够安装的软件的最新版本信息。 添加ppa源 更常见的情况是我们需要添加第三方的repositories到apt-get的源中,这些第三方的源就叫PPAs(Personal Package Archives)。添加一个ppa源: sudo apt-add-repository ppa:hzwhuang/ss-qt5 去掉ppa源 但是当这个ppa源不可用时,在使用sudo apt-get update时,会遇到错误 E: The repository 'http://ppa.launchpad.net/hzwhuang/ss-qt5/ubuntu bionic Release' does not have a Release file. 所以我们需要将这个ppa源去掉 sudo apt-add-repository –remove ppa:hzwhuang/ss-qt5
Zotero文献管理配置
Zotero Zotero是一个很好用的文献管理软件,它有分级文献管理、文件同步、bibtex导出等等好用的文献管理功能。下面介绍一下我常用的配置: 使用webDAV获得更大的文献存储空间 zotero自带的同步存储空间只有100M,这对于科研工作者来说是远远不够的,zotero自身提供升级的存储套餐,但是you know,我等平民消费不起。所幸,zotero提供webDAV接口进行文件同步。这个功能可以参照这篇文章,里面讲得比较详细了,这里不再赘述。 使用zotfile进行文件管理 zotfile是zotero的一个插件(add-on),十分好用,配合文件同步,它可以使你能够在移动平台上轻松访问、annotate你的论文文件,然后再同步到zotero中。其配置可以参考这篇文章。 One More Thing 我本人是使用坚果云来同步文件的,并没有使用webDAV的方式。在我的坚果云中,同步了两个文件夹,一个是Zotero(存储zotero下载下来的pdf文档),一个是Zotero_tablet(存储sent到tablet的文档)。而在配置新机器的时候,为了使zotero能够识别本地坚果云同步下来的pdf文件,需要到Zotero -> Preference -> Advanced -> Files and Folders -> Linked Attachment Base Directory设置为上面使用坚果云同步的Zotero文件夹,这样zotero就会自动识别该文件夹下面的pdf文件。
shell Scripts Instances
Extract substring from string I want to extract MM-ABC-19-97-12-12 from 559268 clusterA jobB usersmith R 0:12 1 20-00:00:00 gpu:1 MM-ABC-19-97-12-12 solution (surpose the string is stored in file output.txt): cat output.txt | grep -P 'MM-ABC-19-97-12-12' -o here -P means Perl-style, and -o means match only. If we want to match arbitary number after ‘MM-ABC’, use […]
Difference between Reasoning and Inference
Let’s take a look at their definition The reasoning is how we form inferences about the world, while inference is a conclusion drawn from true or assumed-true facts. Reasoning There are different types of reasoning, which have different advantages. Deduction: a general-to-specific form of reasoning that goes from known truths to specific instances. If the […]
Notes on i386 and amd64
I am always confused by the difference between i386 and amd64 when I try to download some packages for my ubuntu. This has been the second time that I Google for the difference between them. I think I should take a little note on the subject. Differences From stackoverflow, i386 edition can be simply treated […]