[a / b / c / d / e / f / g / gif / h / hr / k / m / o / p / s / t / u / v / vg / vm / vmg / vr / vrpg / vst / w / wg] [i / ic] [r9k / s4s / vip] [cm / hm / lgbt / y] [3 / aco / adv / an / bant / biz / cgl / ck / co / diy / fa / fit / gd / hc / his / int / jp / lit / mlp / mu / n / news / out / po / pol / pw / qst / sci / soc / sp / tg / toy / trv / tv / vp / vt / wsg / wsr / x / xs] [Settings] [Search] [Mobile] [Home]
Board
▼ Settings Mobile Home
4chan
/sci/ - Science & Math

Name
Options
Comment
Options


Gimmicks


PEE text
My Bans
Verification
File

    08/21/20New boards added: /vrpg/, /vmg/, /vst/ and /vm/
    05/04/17New trial board added: /bant/ - International/Random
    10/04/16New board for 4chan Pass users: /vip/ - Very Important Posts
    [Hide] [Show All]




    File: IMG_7515.gif (38 KB, 646x466)
    38 KB GIF
    >AI is still at its infancy
    >We are still using hardware meant for video games to power AI. Once we crack either one or all of organic/analogue/quantum computers, it's over
    >Companies are still focusing on making stuff that hits headlines like AGI. Once they move to actual profitable AI like bespoke specialised AI trained on private data, it's over

    It's insane that even in its infancy, it's still so impressive. It's gonna get so much worse after the "bubble" pops.
    >>
    >>17082448
    SNNs are already used in a lot of applications. they didn't yet cracked it for LLMs. pretty sure they're working on it. huge efficiency gains. like you wouldn't believe. like orders of magnitude. it's pretty nuts. but they didn't yet crack it for LLMs.
    look up SNN neuromorphic hardware, they're analog chips. they do have some digital for interfacing, but the "thinking" bit is fully analog. quite interesting hardware.
    >>
    >>17082501
    Wow. You're so smart and technologically informed. But have you been taking your Thorazine as prescribed? Take it. You wouldn't believe the YUGE efficiency gains for your brain to cull spurious thoughts.
    >>
    File: 6f87g9led.png (1.25 MB, 778x1000)
    1.25 MB PNG
    >>17082501
    >SpikeLLM..etc. and hybrid quantization can boost spiking mechanisms into the 7–70B parameter range
    >neuromorphic chips (loihi 2, FPGA MatMul) juices 1.5B-parameter models with ~10–20× more energy efficiency vs GPUs
    It's coming alright, Jensen be shaking.
    >>
    If there are any further speedups it just means a faster firehose of slop. This bubble is going to pop and all your retarded AI nigger faggots are going to kill yourselves.
    >>
    >>17082658
    What actually causes this much denialism?
    >>
    Google actually designed early neural-network chips optimized for the CNNs they were applying for Google Image Search , they were called Tensor Processing Units (TPUs). And a lot of modern chips, like the apple M chips, have designated NN architectures built into them in addition to graphical parts of the chip.

    The problem is that the NNs that current LLMs use vastly larger sets of weights than older NN applications, and GPUs were already designed to support very big matrices which are basically what 4k and 8k chips are designed for. And in fact, the modern GPUs are pushing the limit of the size of single-wafer layouts, which in turn push the limits of what you can fit on a reasonable 8U or 12U rack electronics unit.

    To move beyond this we may be looking at standard server racks needing to be taller and wider, meaning a complete replacement of the entire industry standard electronics specifications, and remaking every server rack and every board and every cooling system and every data center . Instead GPUs are basically saturating what the current infrastructure supports so they will probably be dominant at least until semiconductor lithography attains smaller than the 2-1 nm process, but already this pushes the physical limitations of silicon semiconductor circuits, especially with regards to the wavelengths of UEV optics
    >>
    >>17082982
    sorry I meant EUV, not UEV.
    >>
    >>17082524
    sarcasm is the lowest form of wit.
    focus on fixing that
    BTC
    bc1qtm4rep7kyp2p28hlkfktpnd0j7uew47vnt2mev
    LTC
    ltc1q9xlaysse0mpfwf025esd69kt9zu3md22gh23du
    ETH
    0x6abA18D203520c8F90ca63eE7426a7bC345D98e6
    SOL
    E5ekoiauCR8yiNp451dmuPzhUxo84P5x3m9WJBK5kxZe
    XRP
    r3jYXNdMk2Vz5hXhKCKE9re8uz93JQFG1r
    DOGE
    DSBq5jRWkiwmEh1G7zBwmQDgRkvRr61fmb
    XMR
    85CTwq5wGjWZw5GgzgwZPrHyZxpLXMK5oZSSSk5j4x9w1bpqzisaWAUZYaAPfh6rP2MZJcaFqF1XmEzkw6YCqJSS2Txu6Z8




    Delete Post: [File Only] Style:
    [Disable Mobile View / Use Desktop Site]

    [Enable Mobile View / Use Mobile Site]

    All trademarks and copyrights on this page are owned by their respective parties. Images uploaded are the responsibility of the Poster. Comments are owned by the Poster.